Spark to Hive

Writes an incoming Spark DataFrame/RDD into a Hive table.

Options

Schema
The optional database schema name.
Table
The name of the table to create.
Drop existing table
Select this option to drop an existing table.
File Format
Choose the file format in which to store the table. Default is ORC.
Compression
Choose the compression codec for the file format.

Input Ports

Icon
DB Connection
Icon
Spark DataFrame/RDD

Output Ports

Icon
DB data referencing the written Hive table

Views

This node has no views

Workflows

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.