Icon

08_​Connecting_​to_​Amazon_​EMR

Connecting to Amazon EMR
This workflow shows how to run a Spark job on an AWS EMR cluster via Apache Livy. It also demonstrates how to use Amazon Athena to query dataset located on an Amazon S3 bucket. Configure connections to S3 and EMR.Please enter your credentials here! Perform simple random forest on the Spark cluster. Connecting to Amazon Athena Select the created tableRead dataset fromAWS Registry of Open DataPartition intotrain and test setTrain a basicRF modelCalculate the prediction scoresVisualizationCreate a tableConnect toAmazon S3Create Spark contextvia LivyGive your Amazoncredentials hereConnect to Athena DB Table Selector CSV to Spark Spark Partitioning Spark Random ForestLearner (Regression) Spark Predictor(Regression) Spark NumericScorer Spark to Table Line Plot DB SQL Executor Amazon S3Connection Create SparkContext (Livy) AmazonAuthentication Amazon AthenaConnector This workflow shows how to run a Spark job on an AWS EMR cluster via Apache Livy. It also demonstrates how to use Amazon Athena to query dataset located on an Amazon S3 bucket. Configure connections to S3 and EMR.Please enter your credentials here! Perform simple random forest on the Spark cluster. Connecting to Amazon Athena Select the created tableRead dataset fromAWS Registry of Open DataPartition intotrain and test setTrain a basicRF modelCalculate the prediction scoresVisualizationCreate a tableConnect toAmazon S3Create Spark contextvia LivyGive your Amazoncredentials hereConnect to AthenaDB Table Selector CSV to Spark Spark Partitioning Spark Random ForestLearner (Regression) Spark Predictor(Regression) Spark NumericScorer Spark to Table Line Plot DB SQL Executor Amazon S3Connection Create SparkContext (Livy) AmazonAuthentication Amazon AthenaConnector

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: dewi
Created at: 2020-05-25
On NodePit since: 2020-09-08
Last update: 2024-04-26
Created with KNIME version: v4.2.0
Tags: AmazonAWSEMRS3Apache LivyAthenaSpark

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!