Spacy Tokenizer

The node converts a string column with raw text to a KNIME Document column using the tokenizer of the provided spaCy model.

Options

Select column: Select a String or Document column that will be tokenized and converted to Document.
Replace column: If checked, the selected column will be replaced by the new documents. Otherwise the documents will be appended as a new column.
Append column: The name of the newly appended column, containing the preprocessed documents.

Python

Select one of Python execution environment options:

use default Python environment for the Redfield NLP nodes
use Conda environment specified by a Conda flow variable (only selectable if such a flow variable is available)

This node has no views

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

To use this node in KNIME, install the extension Redfield NLP Nodes from the below update site following our NodePit Product and Node Installation Guide:

v5.3

A zipped version of the software site can be downloaded here.

Plugin provider: Redfield AB

Plugin version: 1.2.0.202409270307

On NodePit since: 2024-07-11

Last update: 2024-11-15

KNIME versions: v5.3, v5.1, v4.7

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.