OpenAI Chat Model Connector

This node establishes a connection with an OpenAI Chat Model. After successfully authenticating using the OpenAI Authenticator node, you can select a chat model from a predefined list.

If OpenAI releases a new model that is not among the listed models, you can also select from a list of all available OpenAI models but you have to ensure that selected model is compatible with the OpenAI Chat API.

Note that chat models can also be used as LLMs because they are actually a subcategory of LLMs that are optimized for chat-like applications.

Options

OpenAI Chat Model Selection

Model ID

Select the chat-optimized OpenAI model ID to be used.

Available options:

  • gpt-3.5-turbo: Most capable GPT-3.5 model and optimized for chat at 1/10th the cost of text-davinci-003.
  • gpt-3.5-turbo-16k: Same capabilities as the standard gpt-3.5-turbo model but with 4 times the context.
  • gpt-4: More capable than any GPT-3.5 model, able to do more complex tasks, and optimized for chat.
  • gpt-4-32k: Same capabilities as the base gpt-4 mode but with 4x the context length.
Specific Model ID

Select from a list of all available OpenAI models. The model chosen has to be compatible with OpenAI's Chat API.

Model Parameters

Maximum Response Length (token)

The maximum number of tokens to generate.

The token count of your prompt plus max_tokens cannot exceed the model's context length.

Temperature

Sampling temperature to use, between 0.0 and 2.0. Higher values means the model will take more risks. Try 0.9 for more creative applications, and 0 for ones with a well-defined answer. It is generally recommend altering this or top_p but not both.

Completions generation

How many chat completion choices to generate for each input message. This parameter generates many completions and can quickly consume your token quota.

top_p

An alternative to sampling with temperature, where the model considers the results of the tokens (words) with top_p probability mass. Hence, 0.1 means only the tokens comprising the top 10% probability mass are considered.

Input Ports

Icon

Validated authentication for OpenAI.

Output Ports

Icon

Configured OpenAI Chat Model connection.

Popular Predecessors

  • No recommendations found

Popular Successors

  • No recommendations found

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension KNIME AI Extension (Labs) from the below update site following our NodePit Product and Node Installation Guide:

v5.1

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland
Plugin version: 5.1.3.202311161118
On NodePit since: 2023-09-21
Last update: 2024-10-02
KNIME versions: From v5.1 to v5.1

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!