0 ×

Correlation Filter

KNIME Base Nodes version 4.4.0.v202106241539 by KNIME AG, Zurich, Switzerland

This node uses the model as generated by a Correlation node to determine which columns are redundant (i.e. correlated) and filters them out. The output table will contain the reduced set of columns.

The filtering step works roughly as follows: For each column in the correlation model the count of correlated columns is determined given a threshold value for the correlation coefficient (specified in the dialog). The column with the most correlated columns is chosen to "survive" and all correlated columns are filtered out. This procedure is repeated until no more columns can be identified. The problem of finding a minimum set of columns to satisfy the constraints is difficult to solve analytically. This method applied here is known to be good approximation, however.

Options

Columns from Model: Displays the set of columns for which the model has information. These columns must also be present in the input data table. The (automatically) selected elements in the list will be present in the output table. This list can not be edited.
Correlation Threshold: Choose the correlation threshold here. The higher the value the fewer columns get filtered out. Hit Enter or click the "Calculate" to see a preview of the filtered columns. The counts of included vs. excluded columns are shown in the label.
Calculate: Click this button to update the statistics. It will determine the reduced set of columns using the procedure outlined above.

Input Ports

: The model from the correlation node.
: Numeric input data to filter. It must contain the set of columns that were used to create the correlation model. (Typically you connect the input data from the correlation node here.)

Output Ports

: Filtered data from input.

Best Friends (Incoming)

~~Linear Correlation~~ (44 %) Deprecated
Linear Correlation (14 %)
Column Filter (4 %) Streamable
Low Variance Filter (4 %)
Normalizer (3 %)
Show all 205 recommendations

Best Friends (Outgoing)

Partitioning (12 %)
Low Variance Filter (11 %)
Column Filter (5 %) Streamable
Denormalizer (5 %) Streamable
Reference Column Filter (4 %) Streamable
Show all 299 recommendations

Workflows

01_Model_Selection_Sampled (KNIME Hub)
01_Simple_Neural_Network (KNIME Hub)
01_Simple_Neural_Network_solution (KNIME Hub)
02_Techniques_for_Dimensionality_Reduction (KNIME Hub)
03_NIR_Spectral_Data_Inhouse_Database_Search (KNIME Hub)
Show all 39 workflows

Installation

To use this node in KNIME, install KNIME Base nodes from the following update site:

KNIME 4.4

A zipped version of the software site can be downloaded here.

You don't know what to do with this link? Read our NodePit Product and Node Installation Guide that explains you in detail how to install nodes to your KNIME Analytics Platform.

Wait a sec! You want to explore and install nodes even faster? We highly recommend our NodePit for KNIME extension for your KNIME Analytics Platform. Browse NodePit from within KNIME, install nodes with just one click and share your workflows with NodePit Space.

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.