Icon

20200604 Pikairos iterate over a list and optimize speed of the searching v2

20200603 Pikairos iterate over a list and optimize speed of the searching

What I have so far:

I have a list of strings (per row around 2000 words)
Columns with words (around 300 words per column) which ones I have to compare with list of strings
Input from the user for number of hits that has to happen

What I want to do?

I want to compare each word from the list of strings with each word from the columns with words. How can I do that?
I want to optimize my search. How? Example: if word on position 133 in list of strings has a match with 53rd word from the column of words I want KNIME to check if user entered one hit has to happen or more hits are required…if just one hit is required I want that KNIME stops iterating over the rest of the list of strings. If number of hits is 2,3,4,5 or more, KNIME should continue iterating until the count of hits is the same that user entered.
How can I do that?

Example of solution for this would be amazing. Thanks in advance.

Kind regards,
Denis

Create a Columnwith RowIDto rememberRowID originof wordsUngroupthe lists keepingtheir RowID originJoin the words from sentenceswith the words in dictionaryGroup "detected" wordsby sentence of origin (RowID)to compute what dictiionary wordsappear in sentences and count themI suppose here thatyou count a "same" wordonly once and not every time it appearsif repeated in the sentence.Otherwise change "unique count" by "count"and "set" by "list" in the aggregationHere comesyour magic numberto decide what sentences are keptbased on theminimum word occurenciesNow is set bythe "Count" Integer Input VariableJoin results withinitial sentencesThe sentences havingat list 4 wordsfrom the dictionarycolumn with wordsliste of stringsuser input - number of hitsRemove square braketsCreate a list of dataSplit sentences tobecome single wordsCreate a dictionaryof wordsNode 20RowID Ungroup Joiner GroupBy Row Filter Joiner InteractiveTable (local) Table Creator Table Creator Integer Input String Manipulation Cell Splitter Cell Splitter Ungroup GroupBy Create a Columnwith RowIDto rememberRowID originof wordsUngroupthe lists keepingtheir RowID originJoin the words from sentenceswith the words in dictionaryGroup "detected" wordsby sentence of origin (RowID)to compute what dictiionary wordsappear in sentences and count themI suppose here thatyou count a "same" wordonly once and not every time it appearsif repeated in the sentence.Otherwise change "unique count" by "count"and "set" by "list" in the aggregationHere comesyour magic numberto decide what sentences are keptbased on theminimum word occurenciesNow is set bythe "Count" Integer Input VariableJoin results withinitial sentencesThe sentences havingat list 4 wordsfrom the dictionarycolumn with wordsliste of stringsuser input - number of hitsRemove square braketsCreate a list of dataSplit sentences tobecome single wordsCreate a dictionaryof wordsNode 20RowID Ungroup Joiner GroupBy Row Filter Joiner InteractiveTable (local) Table Creator Table Creator Integer Input String Manipulation Cell Splitter Cell Splitter Ungroup GroupBy

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Molina
Created at: 2020-06-03
On NodePit since: 2022-02-06
Last update: 2024-04-27
Created with KNIME version: v4.1.2

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!