0 ×

Kafka Producer

StreamableApache Kafka integration version 4.1.0.v201911110939 by KNIME AG, Zurich, Switzerland

This node allows to send messages to Kafka.

Options

Settings

Client ID
An id string to pass to the Kafka cluster when making requests. This string can be included as a logical application name in server-side request logging, thus making it easier to track the source of requests beyond ip/port.
Topic(s)
A list of topics the producer sends the messages to. The topics list has to be entered in the form topic1,topic2,....
Message column
A String or JSON column containing the messages that have to be send to the Kafka cluster.
Sending type
Defines how messages are send. If Asynchronously or Synchronously is selected, the node will throw an exception if any of the message could not be send to Kafka. In the case of Fire and forget it is unkown whether or not the message has been successfully sent.

Transaction Settings

Use transaction
Specifies whether the messages have to be send in a transactional fashion or not.
Transaction ID
The transaction id of the message producer. This id has to be unique.
Transaction Commit Options
Allows to specify the number of messages send per transaction.
  • Input end This option ensures that the whole input is send in a single transaction
  • Batchwise This option sends a fixed number of messages per transaction. Larger values result in less transactions but might stall message consumption.

Advanced Settings

Advanced Settings
Allows to specify additional producer related options, e.g., request timeout and number of retries. For further details on the individual options see the tooltip or consult the official Kafka documentation.

Input Ports

Data table holding the column to be send to the Kafka cluster
Connection details used to create the Kafka Producer

Best Friends (Incoming)

Installation

To use this node in KNIME, install KNIME Extension for Apache Kafka (Preview) from the following update site:

KNIME 4.1
Wait a sec! You want to explore and install nodes even faster? We highly recommend our NodePit for KNIME extension for your KNIME Analytics Platform.

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.