Dictionary Replacer (File-based)

Replaces terms contained in the input documents that match with specified dictionary terms by the corresponding specified value. The dictionary file need to be specified. Each line of the dictionary file must contain a key and a value. If the key matches with a term, the term is replaced by the value. The key and value pairs must be separated by ",".

Options

Preprocessing options

Document column

The column containing the documents to preprocess.

Replace documents

If checked, the documents will be replaced by the new preprocessed documents. Otherwise the preprocessed documents will be appended as new column.

Append column

The name of the new appended column, containing the preprocessed documents.

Ignore unmodifiable tag

If checked, unmodifiable terms will be preprocessed too.

Dictionary options

Dictionary file

The path of the dictionary file to use.

Replace words not in the dictionary by

If checked, all words that are not available in the dictionary are replaced by the string entered in the text field.
Note: Entering an empty string or a string consisting solely of whitespaces leads to the removal of all terms not contained in the dictionary.

Word tokenizer

Select the tokenizer used for word tokenization. Go to Preferences -> KNIME -> Textprocessing to read the description for each tokenizer.

Input Ports

The input table which contains the documents to preprocess.

Output Ports

The output table which contains the preprocessed documents.

Best Friends (Incoming)

• Snowball Stemmer (6 %) Streamable
• Strings To Document (6 %) StreamableDeprecated
• Cell Replacer (4 %) Streamable
• GroupBy (4 %) 
• String Replace (Dictionary) (4 %) Streamable
• Punctuation Erasure (4 %) Streamable
• Bag of Words Creator (4 %) Deprecated
• Strings To Document (4 %) Streamable
• CSV Reader (2 %) 
• File Reader (2 %) Streamable
• Table Creator (2 %) 
• Loop End (2 %) 
• Concatenate (2 %) Streamable
• Column Combiner (2 %) Streamable
• Column Filter (2 %) Streamable
• Row Filter (2 %) Streamable
• String Replacer (2 %) Streamable
• Statistics (2 %) 
• XLS Reader (2 %) Deprecated
• Java Snippet Row Filter (2 %) Streamable
• Frequency Filter (2 %) 
• Case Converter (2 %) Streamable
• Dictionary Filter (2 %) Streamable
• Dictionary Replacer (2 %) Streamable
• Kuhlen Stemmer (2 %) Streamable
• Modifiable Term Filter (2 %) Streamable
• Number Filter (2 %) Streamable
• RegEx Filter (2 %) Streamable
• Replacer (2 %) Streamable
• Stop Word Filter (2 %) StreamableDeprecated
• Stanford Tagger (2 %) Streamable
• Bag Of Words Creator (2 %) 
• Document Vector (2 %) 
• Sentence Extractor (2 %) 
• Term To String (2 %) 
• Term To String (2 %) 
• Term To Structure (2 %) 
• Show all 37 recommendations

Best Friends (Outgoing)

• Document Data Extractor (8 %) 
• Document Viewer (8 %) 
• TF (6 %) 
• Dictionary Replacer (6 %) Streamable
• Bag of Words Creator (6 %) Deprecated
• Column Filter (3 %) Streamable
• Column Rename (3 %) Streamable
• String Replacer (3 %) Streamable
• XLS Writer (3 %) Deprecated
• NGram Creator (3 %) 
• NGram Creator (3 %) 
• Case Converter (3 %) Streamable
• Dictionary Filter (3 %) Streamable
• Kuhlen Stemmer (3 %) Streamable
• N Chars Filter (3 %) Streamable
• Porter Stemmer (3 %) Streamable
• Punctuation Erasure (3 %) Streamable
• Replacer (3 %) Streamable
• Snowball Stemmer (3 %) Streamable
• Stop Word Filter (3 %) StreamableDeprecated
• Stop Word Filter (3 %) StreamableDeprecated
• Dictionary tagger (3 %) StreamableDeprecated
• Dictionary Tagger (3 %) Streamable
• POS tagger (3 %) StreamableDeprecated
• Bag Of Words Creator (3 %) 
• Document Data Extractor (3 %) Deprecated
• Strings To Document (3 %) StreamableDeprecated
• String To Term (3 %) 
• UNIX Timestamp to Date&Time (3 %) Streamable
• Show all 29 recommendations

Installation

To use this node in KNIME, install KNIME Textprocessing from the following update site:

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.