Hive to Spark (legacy)

This node is part of the legacy database framework and will be deprecated at the end of 2022. For more information on how to migrate to the new database framework see the migration section of the database documentation.

Converts an incoming Hive query into a Spark DataFrame/RDD by executing the query in Spark.

Notice: On clusters with Hortonworks HDP 3.x, this node requires Hive Warehouse Connector to be part of the Spark classpath and correctly configured. Please consult the HDP documentation.

Input Ports

Icon
Input data (Hive query).
Icon
Required Spark context.

Output Ports

Icon
Spark DataFrame/RDD

Views

This node has no views

Workflows

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.