Icon

JKISeason3-30_​Do these Two Questions Have the Same Intent_​rev1

Do these Two Questions Have the Same Intent?

Challenge 30

Level: Hard

Description: You work for a company that wants to improve its support for customers. Once a customer submits a question, a system should find similar questions that were submitted in the past in its database, fetch the answers that were given, and send all this data to a customer service representative. The representative should review these answers and leverage them to assist the current customer. As a first step to create this system, you should create a mechanism that recognizes whether two questions have the same intent. This will be key for finding relevant previous questions in the company’s database, leading to more effective support. Given a dataset of question pairs, annotated with whether or not they have the same intent, create a classifier that learns how to make this distinction. Hint: You can find more information about the datasets here. Hint 2: The KNIME Textprocessing extension is helpful for creating features to represent the questions.

Author: Aline Bessa

URL: Dataset https://hub.knime.com/alinebessa/spaces/Just%20KNIME%20It!%20Season%203%20-%20Datasets/Challenge%2030%20-%20Dataset~ceSHb705qrMSl269/

Node 1Node 2Node 10Node 12Node 13Node 19Node 20Node 21Node 22Node 23Node 25Node 26Node 27Node 28Node 35Node 57Node 58Node 59Node 60Node 63Node 64Node 68Node 69Node 70Node 71Node 73Node 74Node 75Node 76Node 77Node 78Node 79Node 80Node 81Node 84Node 85Node 87Node 88Node 89Node 90Node 91Node 92Node 93Node 94Node 95Node 99Node 100Node 101Node 104Node 105Node 107Node 112Node 113Node 115Node 118Node 119Node 120Node 121Node 122Node 123Node 124Node 125Node 127Node 128Node 129Node 130Node 131Node 132Node 133Node 135Node 136Node 137CSV Reader Local GPT4AllLLM Connector LLM Prompter Row Filter ConstantValue Column GPT4All EmbeddingsConnector FAISS VectorStore Creator Column Filter CSV Writer Variable toTable Row Path to String Vector StoreRetriever String Manipulation Column Filter CSV Reader Column Splitter Row Filter String Manipulation Missing ValueColumn Filter ReferenceRow Filter Table Creator Column Splitter Row Filter String Manipulation Missing ValueColumn Filter ReferenceRow Filter Cell Splitter String Matcher Table Transposer Table Transposer DuplicateRow Filter DuplicateRow Filter Missing Value Missing Value Row Aggregator RecursiveLoop Start Recursive Loop End Table Rowto Variable Column Filter RowID ConstantValue Column Empty Table Creator String Manipulation(Multi Column) Concatenate Row Aggregator Cell Splitter ConstantValue Column Concatenate Column Filter RowID CSV Writer Recursive Loop End Variable Filter Math Formula(Variable) String Manipulation(Multi Column) Random Matcher Number to String DecisionTree Learner Decision TreePredictor Table Creator Column Filter String Distances Aggregated Distance String Distances K Nearest Neighbor(Distance Function) Missing Value Row Filter Column Splitter Column Splitter Sorter Value Lookup Extract TableDimension Node 1Node 2Node 10Node 12Node 13Node 19Node 20Node 21Node 22Node 23Node 25Node 26Node 27Node 28Node 35Node 57Node 58Node 59Node 60Node 63Node 64Node 68Node 69Node 70Node 71Node 73Node 74Node 75Node 76Node 77Node 78Node 79Node 80Node 81Node 84Node 85Node 87Node 88Node 89Node 90Node 91Node 92Node 93Node 94Node 95Node 99Node 100Node 101Node 104Node 105Node 107Node 112Node 113Node 115Node 118Node 119Node 120Node 121Node 122Node 123Node 124Node 125Node 127Node 128Node 129Node 130Node 131Node 132Node 133Node 135Node 136Node 137CSV Reader Local GPT4AllLLM Connector LLM Prompter Row Filter ConstantValue Column GPT4All EmbeddingsConnector FAISS VectorStore Creator Column Filter CSV Writer Variable toTable Row Path to String Vector StoreRetriever String Manipulation Column Filter CSV Reader Column Splitter Row Filter String Manipulation Missing ValueColumn Filter ReferenceRow Filter Table Creator Column Splitter Row Filter String Manipulation Missing ValueColumn Filter ReferenceRow Filter Cell Splitter String Matcher Table Transposer Table Transposer DuplicateRow Filter DuplicateRow Filter Missing Value Missing Value Row Aggregator RecursiveLoop Start Recursive Loop End Table Rowto Variable Column Filter RowID ConstantValue Column Empty Table Creator String Manipulation(Multi Column) Concatenate Row Aggregator Cell Splitter ConstantValue Column Concatenate Column Filter RowID CSV Writer Recursive Loop End Variable Filter Math Formula(Variable) String Manipulation(Multi Column) Random Matcher Number to String DecisionTree Learner Decision TreePredictor Table Creator Column Filter String Distances Aggregated Distance String Distances K Nearest Neighbor(Distance Function) Missing Value Row Filter Column Splitter Column Splitter Sorter Value Lookup Extract TableDimension

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: RB
Created at: 2024-12-11
On NodePit since: 2024-12-19
Last update: 2025-01-20
Created with KNIME version: v5.3.2
Tags: JKISeason3-30

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!