Icon

17106_​Hive_​to_​Spark_​to_​Hive

17106_Hive_to_Spark_to_Hive
Description:This workflow demonstrates the usage of the Hive to Spark and Spark to Hive nodes that allow you totransfer data between Spark and Hive. Requirements:- KNIME Analytics Platform + KNIME Big Data Connectors + KNIME Extension for Apache Spark + KNIME Extensions for Local Big Data EnvironmentsFor details see https://www.knime.com/knime-extension-for-apache-sparkCreated with KNIME 3.7 on 25/02/2019 test dataconvert KNIME table to Spark DataFrameNode 174you might want to change the directoryand table name hereyou might want to change the table name hereNode 177create a ORC-based Hive table from theSpark DataFrameload datainto KNIMEFile Reader Table to Spark Create Local BigData Environment DB Loader DB Table Creator Column Rename Spark to Hive DB Reader Description:This workflow demonstrates the usage of the Hive to Spark and Spark to Hive nodes that allow you totransfer data between Spark and Hive. Requirements:- KNIME Analytics Platform + KNIME Big Data Connectors + KNIME Extension for Apache Spark + KNIME Extensions for Local Big Data EnvironmentsFor details see https://www.knime.com/knime-extension-for-apache-sparkCreated with KNIME 3.7 on 25/02/2019 test dataconvert KNIME table to Spark DataFrameNode 174you might want to change the directoryand table name hereyou might want to change the table name hereNode 177create a ORC-based Hive table from theSpark DataFrameload datainto KNIMEFile Reader Table to Spark Create Local BigData Environment DB Loader DB Table Creator Column Rename Spark to Hive DB Reader

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: koetter
Created at: 2015-05-27
On NodePit since: 2019-09-23
Last update: 2020-03-23
Created with KNIME version: v4.0.1
Tags: Big DataEducation

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!