IDF

Computes three variants of the inverse document frequency (idf) for each term according to the given set of documents and adds a column containing the idf value. Smooth, normalized, and probabilistic idf. The default variant is smooth idf specified as follows: idf(t) = log(1 + (f(D) / f(d, t))).
The normalized idf is defined by: idf(t) = log(f(D) / f(d,t)).
The probabilistic idf is defined by: idf(t) = log((f(D) - f(d,t)) / f(d,t)), where f(D) is the number of all documents and f(d,t) is the number of documents containing term t.

Options

Frequency options

IDF variant
Choose which variant of the inverse document frequency to compute. Default is smooth idf.

Document selection

Document Column
Specifies the document column to use for frequency counting.

Input Ports

Icon
The input table which contains terms and documents.

Output Ports

Icon
The output table which contains terms documents and a corresponding frequency value.

Popular Predecessors

Popular Successors

Views

This node has no views

Workflows

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension KNIME Textprocessing from the below update site following our NodePit Product and Node Installation Guide:

v5.3

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland
Plugin version: 5.3.2.v202409040940
On NodePit since: 2024-07-09
Last update: 2024-11-21
KNIME versions: Since v3.6

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!