Icon

kn_​example_​h2o_​sparkling_​water_​autoencoder

Combine Big Data, Spark and H2O.ai Sparkling Water

- load data into (local) Big Data environment
- load data into Spark context
- load data into H2O.ai Sparkling Water context
- build H2O model in Big Data environment
- use H2O model
- check accuracy of model
- store model as MOJO file
- reuse stored model on ‚new‘ data with or without the sparkling water context


Combine Big Data, Spark and H2O.ai Sparkling Waterhttps://forum.knime.com/t/integrating-knime-with-bigdata-platform/18164/3?u=mlauber71 - load data into (local) Big Data environment- load data into Spark context- load data into H2O.ai Sparkling Water context- build H2O model in Big Data environment- use H2O model- check accuracy of model- store model as MOJO file- reuse stored model on ‚new‘ data with or without the sparkling water context iris.tableclean uplearnpredict/data/my_model.zip/data/my_model.zipscore newdata without H2Ocontext/big_data//data/Node 70Node 71Node 72Node 73Node 74 Table Reader Create H2O SparklingWater Context H2O Partitioning H2O Model to MOJO H2O To Spark Spark Scorer Destroy SparkContext H2O RandomForest Learner H2O Predictor(Classification) H2O MOJO Writer H2O MOJO Reader Spark H2O MOJO Predictor(Classification) Spark to Table Metadata forBig Data Create Local BigData Environment Spark to H2O(deprecated) Column Rename Table to Spark Spark H2O MOJO Predictor(Autoencoder) H2O MOJO Predictor(Autoencoder) H2O k-Means Spark H2O MOJO Predictor(Dimension Reduction) Combine Big Data, Spark and H2O.ai Sparkling Waterhttps://forum.knime.com/t/integrating-knime-with-bigdata-platform/18164/3?u=mlauber71 - load data into (local) Big Data environment- load data into Spark context- load data into H2O.ai Sparkling Water context- build H2O model in Big Data environment- use H2O model- check accuracy of model- store model as MOJO file- reuse stored model on ‚new‘ data with or without the sparkling water context iris.tableclean uplearnpredict/data/my_model.zip/data/my_model.zipscore newdata without H2Ocontext/big_data//data/Node 70Node 71Node 72Node 73Node 74 Table Reader Create H2O SparklingWater Context H2O Partitioning H2O Model to MOJO H2O To Spark Spark Scorer Destroy SparkContext H2O RandomForest Learner H2O Predictor(Classification) H2O MOJO Writer H2O MOJO Reader Spark H2O MOJO Predictor(Classification) Spark to Table Metadata forBig Data Create Local BigData Environment Spark to H2O(deprecated) Column Rename Table to Spark Spark H2O MOJO Predictor(Autoencoder) H2O MOJO Predictor(Autoencoder) H2O k-Means Spark H2O MOJO Predictor(Dimension Reduction)

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: m_lauber
Created at: 2019-09-20
On NodePit since: 2022-02-06
Last update: 2024-11-21
Created with KNIME version: v4.1.2
Tags: knimeh2oh2o.aisparksparklingwatermodelmojobigdatabig data

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!