0 ×

Spark Correlation Matrix

KNIME Extension for Apache Spark core infrastructure version 4.2.0.v202007072005 by KNIME AG, Zurich, Switzerland

This node computes the correlation matrix for the selected input columns using the MLlib Statistics package.

Options

Correlation method
Feature columns
Columns to compute the correlation for

Input Ports

Icon
Spark DataFrame/RDD to compute correlation matrix for.

Output Ports

Icon
Spark DataFrame/RDD representing the correlation matrix.
Icon
Correlation variables in a square matrix
Icon
A model containing the correlation measures. This model is appropriate to be read by the Spark Correlation Filter node.

Views

Correlation Matrix
Squared table view showing the pair-wise correlation values of all columns. The color range varies from dark red (strong negative correlation), over white (no correlation) to dark blue (strong positive correlation). If a correlation value for a pair of column is not available, the corresponding cell contains a missing value (shown as cross in the color view).

Best Friends (Incoming)

Best Friends (Outgoing)

Workflows

Installation

To use this node in KNIME, install KNIME Extension for Apache Spark from the following update site:

KNIME 4.2

A zipped version of the software site can be downloaded here.

You don't know what to do with this link? Read our NodePit Product and Node Installation Guide that explains you in detail how to install nodes to your KNIME Analytics Platform.

Wait a sec! You want to explore and install nodes even faster? We highly recommend our NodePit for KNIME extension for your KNIME Analytics Platform. Browse NodePit from within KNIME, install nodes with just one click and share your workflows with NodePit Space.

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.