Kafka Producer

This node allows to send messages to Kafka.

Options

Settings

Client ID

An id string to pass to the Kafka cluster when making requests. This string can be included as a logical application name in server-side request logging, thus making it easier to track the source of requests beyond ip/port.

Topic(s)

A list of topics the producer sends the messages to. The topics list has to be entered in the form topic1,topic2,....

Message column

A String or JSON column containing the messages that have to be send to the Kafka cluster.

Sending type

Defines how messages are send. If Asynchronously or Synchronously is selected, the node will throw an exception if any of the message could not be send to Kafka. In the case of Fire and forget it is unkown whether or not the message has been successfully sent.

Transaction Settings

Use transaction

Specifies whether the messages have to be send in a transactional fashion or not.

Transaction ID

The transaction id of the message producer. This id has to be unique.

Transaction Commit Options

Allows to specify the number of messages send per transaction.

• Input end This option ensures that the whole input is send in a single transaction
• Batchwise This option sends a fixed number of messages per transaction. Larger values result in less transactions but might stall message consumption.

Advanced Settings

Advanced Settings

Allows to specify additional producer related options, e.g., request timeout and number of retries. For further details on the individual options see the tooltip or consult the official Kafka documentation.

Views

This node has no views

Workflows

• 2. Kafka ProducerKNIME Hub
• 3. Model Deployment with kafkaKNIME Hub
• Kafka_demoKNIME Hub
• Kafka_integrationKNIME Hub

Links

• No links available

Developers