GPT4All KNIME - Creating Vector Store

Create a Vector Store with GPT4All from a PDF and query it with local GPT4All instance

• you need Ollama installed and ready to run on your machine, also you should have GPt4All installed

• tested it with Llama 3.2

• Embeddings done with GPT4All

MEDIUM Blog: Creating a Local LLM Vector Store from PDFs with KNIME and GPT4All

https://medium.com/p/311bf61dd20e

MEDIUM Blog: KNIME, AI and local Large Language Models (LLM)

https://medium.com/p/cef650fc142b

KNIME for Generative AI

https://hub.knime.com/-/collections/~D4ckx2q_J5FPBQXu/

joinSep("\n\n",

"You are an AI expert to give helpful answers.",

"Use the following pieces of context to answer the question at the end.",

"If you don't know the answer, just say that you don't know, don't try to make up an answer.",

join("{",joinSep("\n\n",$Retrieved documents$),"}"),

join("Question: {",$Question$,"}"),

"Helpful Answer:")

Recommended Small Models - .gguf

https://huggingface.co/collections/bartowski/recommended-small-models-674735e41843e36cfeff92dc

You can also use DeepSeek with this - if wou dare ...

https://forum.knime.com/t/deepseek-models-supported/86009/3?u=mlauber71