Spark Normalizer

This node normalizes the values of all selected (numeric) columns.

Options

Min-max normalization

Linear transformation of all values such that the minimum and maximum in each column are as given.

Z-score normalization (Gaussian)

Linear transformation such that the values in each column are Gaussian-(0,1)-distributed, i.e. mean is 0.0 and standard deviation is 1.0.

Normalization by decimal scaling

The maximum value in a column (both positive and negative) is divided j-times by 10 until its absolute value is smaller or equal to 1. All values in the column are then divided by 10 to the power of j.

Input Ports

Spark DataFrame/RDD requiring normalization of some or all columns.

Output Ports

Spark DataFrame/RDD with normalized columns.

PMML document containing normalization parameters, which can be used in the "Spark Compiled Transformations Applier" node to normalize test data the same way as the training data has been normalized.

Best Friends (Incoming)

• Spark Category To Number (18 %) 
• Spark Missing Value (17 %) 
• Table to Spark (16 %) Streamable
• Spark Column Filter (12 %) 
• Spark GroupBy (8 %) 
• Show all 22 recommendations

Best Friends (Outgoing)

• Spark k-Means (27 %) 
• Spark Partitioning (8 %) 
• Spark Decision Tree Learner (8 %) 
• Spark Transformations Applier (6 %) 
• Spark Linear Regression Learner (6 %) 
• Show all 33 recommendations

Workflows

• 09_​Big_​Data_​Irish_​Meter_​on_​Spark_​only (KNIME Hub) 
• 09_​Big_​Data_​Irish_​Meter_​on_​Spark_​only (KNIME Hub) 
• 12_​Hadoop Hive meets Excel-Your Flight is boarding now (KNIME Hub) 
• 17108_​Big_​Data_​Irish_​Meter_​on_​Spark_​only (KNIME Hub) 
• s_​401_​spark_​label_​encoder (KNIME Hub) 

Installation

To use this node in KNIME, install KNIME Extension for Apache Spark from the following update site:

A zipped version of the software site can be downloaded here.

You don't know what to do with this link? Read our NodePit Product and Node Installation Guide that explains you in detail how to install nodes to your KNIME Analytics Platform.

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.