Icon

05_​Hive_​to_​Spark_​to_​Hive

Hive to Spark and Spark to Hive

This workflow demonstrates the usage of the Hive to Spark and Spark to Hive nodes that allow you to transfer data between Apache Spark and Apache Hive.

To run this workflow on a remote cluster, use an HDFS Connection node, Hive Connector node, and Create Spark Context (Livy) node (available in the KNIME Big Data Connectors Extension) in place of the Create Local Big Data Environment node.

Hive to Spark to Hive This workflow demonstrates the usage of the Hive to Spark and Spark to Hive nodes that allow you to transfer data between Apache Spark and Apache Hive. Convert Hive queryto Spark DataFrameConvert Spark DataFrameto Hive tableload datainto KNIMEtest datacreate the test tableload thetest table Hive to Spark Spark to Hive DB Reader File Reader Create Local BigData Environment DB Table Creator DB Loader Hive to Spark to Hive This workflow demonstrates the usage of the Hive to Spark and Spark to Hive nodes that allow you to transfer data between Apache Spark and Apache Hive. Convert Hive queryto Spark DataFrameConvert Spark DataFrameto Hive tableload datainto KNIMEtest datacreate the test tableload thetest tableHive to Spark Spark to Hive DB Reader File Reader Create Local BigData Environment DB Table Creator DB Loader

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: koetter
Created at: 2015-05-27
On NodePit since: 2019-07-12
Last update: 2024-04-26
Created with KNIME version: v4.5.0
Tags: SparkHiveHadoopBig DataSQL

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!