Spark to Hive

This Node Is Deprecated — This version of the node has been replaced with a new and improved version. The old version is kept for backwards-compatibility, but for all new workflows we suggest to use the version linked below.

This node is part of the deprecated database framework. For more information on how to migrate to the new database framework see the migration section of the database documentation.

Converts an incoming Spark DataFrame/RDD into a Hive table

Notice: On clusters with Hortonworks HDP 3.x, this node requires Hive Warehouse Connector to be part of the Spark classpath and correctly configured. Please consult the HDP documentation.

Options

Table name: The name of the table to create
Drop existing table: Select this option to drop an existing table
File Format: Choose the file format in which to store the table. Default is ORC.
Compression: Choose the compression codec for the file format.

Input Ports

: JDBC connection
: Spark DataFrame/RDD

Output Ports

: Hive table query

Popular Predecessors

No recommendations found

Popular Successors

No recommendations found

Views

This node has no views

Workflows

No workflows found

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension KNIME Extension for Apache Spark (legacy) from the below update site following our NodePit Product and Node Installation Guide:

v5.2

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland

Plugin version: 5.2.0.v202311021430

On NodePit since: 2023-12-06

Last update: 2024-05-01

Tags: Deprecated

KNIME versions: Since v4.7

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!