Icon

09_​Big_​Data_​Irish_​Meter_​on_​Spark_​only

Local big data Irish meter
Local_Big_Data_Irish_MeterThis workflow uses a portion of the Irish Energy Meter dataset to highlight KNIME's Big Data and Spark functionality. Compute daily, day segmentpercentagesPersist aggregate results to a Hive tablePersist aggregate resultsto HDFS in Parquet formatRead MeterData Aggregations andtime series Extract date-timeattributes Spark SQL Query PCA, K-means,Scatter Plot Spark to Hive Hive to Spark Create Local BigData Environment Load Data Spark to Parquet File Reader(Complex Format) Local_Big_Data_Irish_MeterThis workflow uses a portion of the Irish Energy Meter dataset to highlight KNIME's Big Data and Spark functionality. Compute daily, day segmentpercentagesPersist aggregate results to a Hive tablePersist aggregate resultsto HDFS in Parquet formatRead MeterData Aggregations andtime series Extract date-timeattributes Spark SQL Query PCA, K-means,Scatter Plot Spark to Hive Hive to Spark Create Local BigData Environment Load Data Spark to Parquet File Reader(Complex Format)

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: sfincher
Created at: 2018-06-22
On NodePit since: 2020-04-22
Last update: 2024-04-23
Created with KNIME version: v4.4.0
Tags: HiveSparkSpark PCASpark PivotLocal Big Data EnvironmentBig DataSpark SQLParquetIoTInternet of Things

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!