Icon

09_​Big_​Data_​Irish_​Meter_​on_​Spark_​only

Local big data Irish meter
Local Big Data Irish MeterThis workflow uses a portion of the Irish Energy Meter dataset to highlight KNIME's Big Data and Spark functionality. Compute daily, day segmentpercentagesPersist aggregate results to a Hive tableRead MeterDataPersist aggregate resultsto HDFS in Parquet format Load Data PCA, K-means,Scatter Plot Hive to Spark Spark SQL Query Extract date-timeattributes Aggregations andtime series Spark to Hive CSV Reader Create Local BigData Environment Spark to Parquet Local Big Data Irish MeterThis workflow uses a portion of the Irish Energy Meter dataset to highlight KNIME's Big Data and Spark functionality. Compute daily, day segmentpercentagesPersist aggregate results to a Hive tableRead MeterDataPersist aggregate resultsto HDFS in Parquet format Load Data PCA, K-means,Scatter Plot Hive to Spark Spark SQL Query Extract date-timeattributes Aggregations andtime series Spark to Hive CSV Reader Create Local BigData Environment Spark to Parquet

Nodes

Extensions

Links