Giskard RAGET Evaluator

This node allows to identify potential weaknesses and areas for improvement in a RAG system provided as a workflow by evaluating the correctness of the answers. An LLM is used to compare the workflow's answers to the reference answers of the test set. The test set can be generated with the Giskard RAGET Test Set Generator node.

For more details see the Giskard documentation.

Options

Prompt column: The column in the input table of the workflow that represents the questions for the RAG system.
Response column: The column in the output table of the workflow that represents the LLM responses.

Input Ports

: A large language model or chat model.
: The prediction workflow to analyze with Giskard.
: A test set table generated by the Giskard RAGET Test Set Generator.

Output Ports

: The Giskard report as table.

Popular Predecessors

No recommendations found

Popular Successors

No recommendations found

Views

Giskard report: The Giskard report as HTML.

Workflows

No workflows found

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension KNIME Python Extension Development (Labs) from the below update site following our NodePit Product and Node Installation Guide:

v5.3

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland

Plugin version: 5.3.3.v202410291554

On NodePit since: 2024-09-13

Last update: 2024-11-20

KNIME versions: Since v5.3

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!