0 ×

NGram Creator

KNIME Textprocessing Plug-in version 4.3.0.v202011212014 by KNIME AG, Zurich, Switzerland

This node creates ngrams from the documents of the input table and counts their frequencies. It can be specified whether word or character ngrams are created. Furthermore it can be specified whether the output table is of a bag of words like structure or a data table containing ngrams and their frequencies in the corpus and documents.

Options

N: The N value for ngram creation.
NGram type: The type (Word or Character) specifies whether word or character ngrams are created.
Document column: The column containing the input documents to create the ngrams of.
Output table: Specifies the structure of the output data table. The "Ngram frequencies" option creates an output table consisting of all ngrams and their frequencies in the complete corpus, as well as the documents and sentences or words. Please note that this option is memory consuming for a large number of documents.
The "NGram bag of words" option creates an output data table consisting of ngram and document tuples. A tuple represents the occurrence of an ngram in a document. Additionally the frequency column contains the number of occurrences of the ngram in the document. This option can also be applied on a large set of documents.
Number of maximal parallel processes: Specifies the maximal number of parallel processes running for ngram computation.
Number of documents per process: Specifies the number of documents being processed by a single thread.

Input Ports

: The input table containing the documents.

Output Ports

: The output table containing the ngrams and their corresponding frequencies, or a bag of ngrams.

Best Friends (Incoming)

Strings To Document (16 %) Streamable
Bag Of Words Creator (11 %)
Stop Word Filter (8 %) Streamable
~~Strings To Document~~ (7 %) StreamableDeprecated
~~Bag of Words Creator~~ (5 %) Deprecated
Show all 123 recommendations

Best Friends (Outgoing)

Workflows

00_Guided_Labeling_for_Document_Classification_(legacy) (KNIME Hub)
01_Guided_Labeling_for_Document_Classification (KNIME Hub)
01_Guided_Labeling_for_Document_Classification (KNIME Hub)
02_Active_Learning_for_Document_Classification (KNIME Hub)
03_Weak_Supervision_for_Document_Classification (KNIME Hub)
Show all 14 workflows

Installation

To use this node in KNIME, install KNIME Textprocessing from the following update site:

KNIME 4.3

A zipped version of the software site can be downloaded here.

You don't know what to do with this link? Read our NodePit Product and Node Installation Guide that explains you in detail how to install nodes to your KNIME Analytics Platform.

Wait a sec! You want to explore and install nodes even faster? We highly recommend our NodePit for KNIME extension for your KNIME Analytics Platform. Browse NodePit from within KNIME, install nodes with just one click and share your workflows with NodePit Space.

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.