Icon

1.3 - LLM difference

You can easily download and run the workflow directly in your KNIME installation. We recommend that you use the latest version of the KNIME Analytics Platform for optimal performance.

This workflow compares the outputs generated by OpenAI's gpt-3.5-turbo-instruct (costs $0.0017 / 1K tokens) and the Hugging Face Hub text generation model zephyr-7b-alpha (free to use).

The workflow requires both an OpenAI API key and a Hugging Face Hub access token.

Instructions:

1. If you don't have one yet, register with OpenAI and create a new API key under https://platform.openai.com/account/api-keys.

2. If you don't already have one, create an account on https://huggingface.co/, go to https://huggingface.co/settings/tokens and create a new token.

2. This workflow uses "HuggingFaceH4/zephyr-7b-alpha" model. Text generating models can be found at Hugging Face Hub (see external resources).

URL: Hugging Face Hub https://huggingface.co/
URL: Hugging Face Hub Access Tokens https://huggingface.co/settings/tokens
URL: OpenAI API Keys https://platform.openai.com/account/api-keys

Comparison between OpenAI and Hugging Face Hub LLMs

  • This workflow compares the outputs by OpenAI's gpt-3.5-turbo-instruct (costs $0.0015 / 1K tokens for input and $0.0020 / 1K for output) and the Hugging Face Hub text generation model bloom-560m (free to use).

  • The workflow requires both an OpenAI API key and a Hugging Face Hub access token.

  • To learn more about the workflow, click the left bar and check the description section.


gpt-3.5-turbo-instruct
OpenAI LLM Connector
LLM Prompter
Constant Value Column
Constant Value Column
Authenticate withAPI key
OpenAI Authenticator
Concatenate
To open the view, hover over the node and click the lens icon.
Table View
Authenticate withAPI key
HF Hub Authenticator
HuggingFaceH4/zephyr-7b-alpha
HF Hub LLM Connector
LLM Prompter
OpenAIAPI Key
Credentials Configuration
HF API Key
Credentials Configuration
Data Science is the field..
Table Creator

Nodes

Extensions

Links