Icon

2.3 - ChatModel Temperature

You can easily download and run the workflow directly in your KNIME installation. We recommend that you use the latest version of the KNIME Analytics Platform for optimal performance.

In the context of language models like ChatGPT (which is an example of a large language models), temperature is a parameter that affects the randomness and creativity of the model's output. When generating text, the temperature determines how much the model prioritizes high-probability words and how much it explores less likely options.

A higher temperature, such as 1.0, makes the model more random and creative. It increases the likelihood of generating diverse and unexpected responses. On the other hand, a lower temperature, such as 0.5, makes the model more focused and conservative, favoring more probable and safe responses.

In order to run the workflow you need an OpenAI API key. If you don't have one already, register with OpenAI and create a new API key under https://platform.openai.com/account/api-keys

URL: OpenAI API Keys https://platform.openai.com/account/api-keys

Explore the effect of temperature on ChatGPT

  • This workflow shows how a higher temperature makes ChatGPT (gpt-3.5-turbo) more creative in its answers.

  • In order to run the workflow you need an OpenAI API key. If you don't have one already, register with OpenAI and create a new API key under https://platform.openai.com/account/api-keys

  • To learn more about the workflow, click the left bar and check the description section.



OpenAIAPI Key
Credentials Configuration
Explain me datascience like I am 5
Table Creator
Constant Value Column
Loop End
Counting Loop Start
Math Formula (Variable)
To open the view, hover over the node and click the lens icon.
Table View
LLM Prompter
Authenticate
OpenAI Authenticator
To observe how the temperature value affects the model response, rerun the workflow and select a different model.
OpenAI Chat Model Connector

Nodes

Extensions

Links