Spark Correlation Matrix

This node computes the correlation matrix for the selected input columns using the MLlib Statistics package.

Options

Correlation method

Feature columns

Columns to compute the correlation for

: Spark DataFrame/RDD representing the correlation matrix.
: Correlation variables in a square matrix
: A model containing the correlation measures. This model is appropriate to be read by the Spark Correlation Filter node.

Correlation Matrix: Squared table view showing the pair-wise correlation values of all columns. The color range varies from dark red (strong negative correlation), over white (no correlation) to dark blue (strong positive correlation). If a correlation value for a pair of column is not available, the corresponding cell contains a missing value (shown as cross in the color view).

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

To use this node in KNIME, install the extension KNIME Extension for Apache Spark (legacy) from the below update site following our NodePit Product and Node Installation Guide:

v5.4

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland

Plugin version: 5.4.0.v202411151159

On NodePit since: 2024-12-06

Last update: 2024-12-31

KNIME versions: Since v3.6

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.