---
MEDIUM Blog: KNIME, AI and local Large Language Models (LLM)
https://medium.com/p/cef650fc142b
---
You can easily download and run the workflow directly in your KNIME installation. We recommend that you use the latest version of the KNIME Analytics Platform for optimal performance.
Instructions:
1. Install GPT4All. The installer link can be found in external resources.
2. Download a model via the GPT4All UI (Groovy can be used commercially and works fine). Preferably into the ../gpt4all_models/ folder
3. Use the component to select the right GPT4All LLM model.
4. Run the model either as a block or with the chat component
For running GPT4All models, no GPU or internet required. Please note which models are allowed to be used commercially!
[please download the whole workflow group - https://hub.knime.com/-/spaces/-/latest/~17k4zAECNryrZw1X/]
URL: GPT4All https://gpt4all.io
URL: GPT4All (adapted from this workflow) https://hub.knime.com/-/spaces/-/latest/~Do1baLMPHHm7wMIL/
URL: GPT4All and KNIME: Leverage LLMs that run locally https://forum.knime.com/t/gpt4all-and-knime-leverage-llms-that-run-locally/72498?u=mlauber71
URL: RLHF: Reinforcement Learning from Human Feedback https://huyenchip.com/2023/05/02/rlhf.html
URL: MEDIUM Blog: KNIME, AI and local Large Language Models (LLM) https://medium.com/p/cef650fc142b
URL: MEDIUM Blog: Creating a Local LLM Vector Store from PDFs with KNIME and GPT4All https://medium.com/p/311bf61dd20e
To use this workflow in KNIME, download it from the below URL and open it in KNIME:
Download WorkflowDeploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.
Try NodePit Runner!