Hive to Spark

Imports the result of an incoming Hive query into Spark as a DataFrame/RDD. The query is executed using Spark SQL, which supports a subset of Hive's own SQL dialect. The limitations of Spark SQL are described in the Spark documentation.

Input Ports

: Hive query
: Spark context

Output Ports

: Spark DataFrame/RDD which contains the result of the Hive query

Popular Predecessors

Create Spark Context (Livy)16 %
~~DB Loader~~12 %
Create Local Big Data Environment9 %
DB Loader8 %
Create Spark Context (Jobserver)8 %
Show all 22 recommendations

Popular Successors

Views

This node has no views

Workflows

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension KNIME Extension for Apache Spark (legacy) from the below update site following our NodePit Product and Node Installation Guide:

v5.2

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland

Plugin version: 5.2.0.v202311021430

On NodePit since: 2023-12-06

Last update: 2024-04-19

KNIME versions: Since v4.0

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!