Spark to Hive

Converts an incoming Spark DataFrame/RDD into a Hive table

Notice: On clusters with Hortonworks HDP 3.x, this node requires Hive Warehouse Connector to be part of the Spark classpath and correctly configured. Please consult the HDP documentation.

Options

Table name
The name of the table to create
Drop existing table
Select this option to drop an existing table
File Format
Choose the file format in which to store the table. Default is ORC.
Compression
Choose the compression codec for the file format.

Input Ports

Icon
JDBC connection
Icon
Spark DataFrame/RDD

Output Ports

Icon
Hive table query

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.