LLM Prompter

For each row in the input table, this node sends one prompt to the LLM and receives a corresponding response. Rows and the corresponding prompts are treated in isolation, i.e. the LLM cannot remember the contents of the previous rows or how it responded to them.

Note: If you use the Credentials Configuration node and do not select the "Save password in configuration (weakly encrypted)" option for passing the API key for the LLM connector node, the Credentials Configuration node will need to be reconfigured upon reopening the workflow, as the credentials flow variable was not saved and will therefore not be available to downstream nodes.

Options

Add system message

Specify whether a customizable system message is included in each prompt. This option is only available for chat models. Note that some chat models (e.g. OpenAI's o1-mini) do not support system messages.

Available options:

  • None: No system message will precede the prompts.
  • Global: A specifiable system message will precede each prompt.
  • Column: Each prompt includes an individual system message specified in a column.
System message

The first message given to the model describing how it should behave.

Example: You are a helpful assistant that has to answer questions truthfully, and if you do not know an answer to a question, you should state that.

System message column

The column containing the system message for each prompt.

Prompt column

Column containing prompts for the LLM.

Response column name

Name for the column holding the LLM's responses.

Output format

Choose between different output formats.

Available options:

  • Text: Text output message generated by the model.
  • JSON: When JSON is selected, the model is constrained to only generate strings that parse into valid JSON object. Make sure you include the string "JSON" in your prompt or system message to instruct the model to output valid JSON when this mode is selected. For example: "Tell me a joke. Please only reply in valid JSON." Please refer to the OpenAI guide to see which models currently support JSON outputs.

Input Ports

Icon

A large language model or chat model.

Icon

A table containing a string column with prompts.

Output Ports

Icon

A table containing prompts and their respective answer.

Popular Predecessors

  • No recommendations found

Popular Successors

  • No recommendations found

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension KNIME Python Extension Development (Labs) from the below update site following our NodePit Product and Node Installation Guide:

v5.4

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland
Plugin version: 5.4.1.v202501291500
On NodePit since: 2024-12-06
Last update: 2025-03-11
KNIME versions: Since v5.2

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!