ORC Writer

This Node Is Deprecated — This version of the node has been replaced with a new and improved version. The old version is kept for backwards-compatibility, but for all new workflows we suggest to use the version linked below.
Go to Suggested ReplacementORC Writer
This node writes the KNIME data table into an ORC file. The ORC file can be written locally or on a remote file system.

For remote connections, the writer stores chunks locally and uploads them in parallel into a folder with the given name. The chunks size and the number of chunks that are allowed on local disc, are configurable in the "Chunk Upload" tab which is only enabled for remote file systems.

Options

Output location
A path on the local machine or remote server where the file is written.
Overwrite
If this option is selected the file will be overwritten if it exists
Check directory content
Enabled when using a remote connection and enabling the overwrite option. With this option enabled the node will fail if the content of the directory contains files that do not fit the file format suffix
File Compression
The compression codec used to write the ORC file.

Chunk Upload

Chunk size in rows
The maximum size for an individual chunk.
Number of local chunks
The number of chunks that can be stored temporarily on disc, while the next chunk is written.

Output Type Mapping

Change the KNIME to ORC type mapping configuration for subsequent nodes by selecting a ORC type to the given KNIME Type. The dialog allows you to add new or change existing type mapping rules.

Mapping by Name
Columns that match the given name (or regular expression) and KNIME type will be mapped to the specified ORC type.
Mapping by Type
Columns that match the given KNIME type will be mapped to the specified ORC type.

Input Ports

Icon
An optional connection to the remote file system
Icon
The data table that should be written

Output Ports

This node has no output ports

Popular Predecessors

Popular Successors

Views

This node has no views

Workflows

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension KNIME Extension for Big Data File Formats from the below update site following our NodePit Product and Node Installation Guide:

v4.6

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland
Plugin version: 4.6.0.v202202251607
On NodePit since: 2022-06-11
Last update: 2022-07-02
Tags: StreamableDeprecated
KNIME versions: Since v3.6