Hive to Spark

Imports the result of an incoming Hive query into Spark as a DataFrame/RDD. The query is executed using Spark SQL, which supports a subset of Hive's own SQL dialect. The limitations of Spark SQL are described in the Spark documentation.

Input Ports

Icon
Hive query
Icon
Spark context

Output Ports

Icon
Spark DataFrame/RDD which contains the result of the Hive query

Views

This node has no views

Workflows

Further Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.