Icon

Spark - Payroll Data

Processing 2.74 Million rows and 18 columns of raw data using the ApacheSpark framework. Node 1Read city-widepayroll data(Open Data)Node 3Filter Job TitleSum OT Hoursby Year and Job TitleNode 6Write pre-processeddata forvisuailzationGenerate Full NameFilter Job Titleand Full NameRemove extraspacesCount Employeesby Year and Job TItleNode 12 Create Local BigData Environment CSV Reader Table to Spark Spark Column Filter Spark GroupBy Spark to Table CSV Writer Column Expressions Spark Column Filter Column Expressions Spark GroupBy Spark Joiner Processing 2.74 Million rows and 18 columns of raw data using the ApacheSpark framework. Node 1Read city-widepayroll data(Open Data)Node 3Filter Job TitleSum OT Hoursby Year and Job TitleNode 6Write pre-processeddata forvisuailzationGenerate Full NameFilter Job Titleand Full NameRemove extraspacesCount Employeesby Year and Job TItleNode 12Create Local BigData Environment CSV Reader Table to Spark Spark Column Filter Spark GroupBy Spark to Table CSV Writer Column Expressions Spark Column Filter Column Expressions Spark GroupBy Spark Joiner

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: adity
Created at: 2019-02-14
On NodePit since: 2019-04-03
Last update: 2024-04-16
Created with KNIME version: v3.7.1

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!