0 ×

Spark to Hive

KNIME Extension for Apache Spark core infrastructure version 2.4.0.v201811301556 by KNIME AG, Zurich, Switzerland

Converts an incoming Spark DataFrame/RDD into a Hive table

Notice: On clusters with Hortonworks HDP 3.x, this node requires Hive Warehouse Connector to be part of the Spark classpath and correctly configured. Please consult the HDP documentation.

Options

Table name
The name of the table to create
Drop existing table
Select this option to drop an existing table
File Format
Choose the file format in which to store the table. Default is ORC.
Compression
Choose the compression codec for the file format.

Input Ports

JDBC connection
Spark DataFrame/RDD

Output Ports

Hive table query

Best Friends (Incoming)

Best Friends (Outgoing)

Workflows

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.