0 ×

Kafka Producer

StreamableApache Kafka integration version 0.9.0.v201807061239 by KNIME AG, Zurich, Switzerland

This node allows to send messages to Kafka.

Options

Settings

Client ID
An id string to pass to the Kafka cluster when making requests. This string can be included as a logical application name in server-side request logging, thus making it easier to track the source of requests beyond ip/port.
Topic(s)
A list of topics the producer sends the messages to. The topics list has to be entered in the form topic1,topic2,....
Message column
A String or JSON column containing the messages that have to be send to the Kafka cluster.

Transaction Settings

Use transaction
Specifies whether the messages have to be send in a transactional fashion or not.
Transaction ID
The transaction id of the message producer. This id has to be unique.
Transaction Commit Options
Allows to specify the number of messages send per transaction.
  • Input end This option ensures that the whole input is send in a single transaction
  • Batchwise This option sends a fixed number of messages per transaction. Larger values result in less transactions but might stall message consumption.

Advanced Settings

Advanced Settings
Allows to specify additional producer related options, e.g., request timeout and number of retries. For further details on the individual options see the tooltip or consult the official Kafka documentation.

Input Ports

Data table holding the column to be send to the Kafka cluster
Connection details used to create the Kafka Producer

Update Site

To use this node in KNIME, install Apache Kafka integration from the following update site:

Wait a sec! You want to explore and install nodes even faster? We highly recommend our NodePit for KNIME extension for your KNIME Analytics Platform.