Icon

03 RAG applications with Databricks AI

<p>This workflow demonstrates how you can visually interact with the LLM and embedding model serving endpoints of Databricks. It also showcases a <strong>RAG implementation</strong>, including <strong>vector store</strong> creation, retrieval, and prompt augmentation.</p>

URL: Create custom model serving endpoints https://docs.databricks.com/en/machine-learning/model-serving/create-manage-serving-endpoints.html

03 RAG applications with Databricks AI

This workflow demonstrates how you can visually interact with the LLM and embedding model serving endpoints of Databricks. It also showcases a RAG implementation, including vector store creation, retrieval, and prompt augmentation.

Authenticate and connect to a Databricks Workspace

Connect to Databricks SQL Warehouse and access data for analysis

Connect to LLMs served on Databricks and integrate them to KNIME workflows

Connect to Databricks Embeddings for Retrieval Augmented Generation (RAG) by generating embeddings of documents and storing them in FAISS vector store.

Connect to DatabricksEmbedding Service
Databricks Embedding Model Selector
DB Reader
Retrieve results
Vector Store Retriever
Add documentsto vector store
FAISS Vector Store Creator
Process retrieved documents
Remove columnsthat will be filledwith GenAI info
DB Column Filter
Disabled by default
Reset the table on Databricks
Descriptionsof products:investor agreements
PDF Parser
Analyze sentimentof product reviewsand extract product
LLM Prompter
Validate GenAIresults beforeupdating a tableon Databricks
Table Validator
Product reviews
DB Table Selector
Connect to DatabricksChat Service
Databricks LLM Selector
Update table onDatabricks with theproduct and sentimentvalues generated by AI
DB Update
Create a promptfor each review
Expression
Text chunking
Text Chunker
Databricks SQL Warehouse Connector
New reviews(not analyzed yet)
DB Row Filter
Connect to yourDatabricks workspace
Databricks Workspace Connector
Extract the product and the sentiment into columns
Document Data Extractor

Nodes

Extensions

Links