ORC Writer
StreamableKNIME BigData File Format Extension version 3.7.0.v201812021522 by KNIME AG, Zurich, Switzerland
For remote connections, the writer stores chunks locally and uploads them in parallel into a folder with the given name. The chunks size and the number of chunks that are allowed on local disc, are configurable in the "Chunk Upload" tab which is only enabled for remote file systems.
Options
- Output location
- A path on the local machine or remote server where the file is written.
- Overwrite
- If this option is selected the file will be overwritten if it exists
- Check directory content
- Enabled when using a remote connection and enabling the overwrite option. With this option enabled the node will fail if the content of the directory contains files that do not fit the file format suffix
- File Compression
- The compression codec used to write the ORC file.
Chunk Upload
- Chunk size in rows
- The maximum size for an individual chunk.
- Number of local chunks
- The number of chunks that can be stored temporarily on disc, while the next chunk is written.
Output Type Mapping
Change the KNIME to ORC type mapping configuration for subsequent nodes by selecting a ORC type to the given KNIME Type. The dialog allows you to add new or change existing type mapping rules.
- Mapping by Name
- Columns that match the given name (or regular expression) and KNIME type will be mapped to the specified ORC type.
- Mapping by Type
- Columns that match the given KNIME type will be mapped to the specified ORC type.
Input Ports
Best Friends (Incoming)
Database Connection Table Reader (19 %) 
CSV Reader (6 %) 
File Reader (6 %) Streamable
Table Creator (6 %) 
Loop End (6 %) 
Column Filter (6 %) Streamable
Create Local Big Data Environment (6 %) 
Legacy Date&Time to Date&Time (6 %) Streamable
Upload (3 %) 
Database Reader (3 %) 
Chunk Loop Start (3 %) 
Row Splitter (3 %) Streamable
Column Rename (3 %) Streamable
Row Sampling (3 %) 
String Manipulation (3 %) Streamable
String Manipulation (Variable) (3 %) 
ORC Writer (3 %) Streamable
Azure Blob Store Connection (3 %) - DB Query Reader (Labs) (3 %)
Date&Time to String (3 %) Streamable- Show all 20 recommendations
Best Friends (Outgoing)
ORC Reader (40 %) Streamable
Database Connector (20 %) 
Database SQL Executor (10 %) 
Database Table Creator (10 %) - ORC Writer (10 %) Streamable
Amazon Redshift Connector (10 %) - Show all 6 recommendations
Workflows
08_Learning_Asociation_Rule_for_Next_Restaurant_Prediction- 02_Fetch_And_Transform_PubChem_Data
Installation
To use this node in KNIME, install KNIME BigData File Format Extension from the following update site: