Parquet Reader

Reader for Parquet files. It reads either single files or all files in a given directory.

Options

Input

The file or directory to read.

Input Type Mapping

Change the Parquet to KNIME type mapping configuration for subsequent nodes by selecting a KNIME type to the given Parquet Type. The dialog allows you to add new or change existing type mapping rules.

Mapping by Name

Columns that match the given name (or regular expression) and Parquet type will be mapped to the specified KNIME type.

Mapping by Type

Columns that match the given Parquet type will be mapped to the specified KNIME type.

Input Ports

Optional port for a remote connection.

Output Ports

Data table containing the data of the Parquet file.

Best Friends (Incoming)

• Amazon S3 Connection (43 %) 
• Parquet Writer (21 %) Streamable
• Table Row To Variable Loop Start (14 %) 
• String Manipulation (Variable) (7 %) 
• HDFS Connection (7 %) 
• Spark to Parquet (7 %) 
• Show all 6 recommendations

Best Friends (Outgoing)

• Row Filter (25 %) Streamable
• Column Filter (13 %) Streamable
• Parquet Writer (13 %) Streamable
• GroupBy (8 %) 
• R View (Table) (8 %) 
• String to Date&Time (8 %) Streamable
• Double To Int (4 %) Streamable
• Joiner (4 %) 
• Sorter (4 %) 
• String Manipulation (4 %) Streamable
• CASE Switch Data (End) (4 %) 
• Table Difference Checker (4 %) 
• Show all 12 recommendations

Workflows

• kn_​example_​r_​read_​parquet_​file
• kn_​example_​r_​read_​single_​csv_​file
• kn_​example_​r_​read_​single_​xlsx_​file
• m_​120_​build_​model_​one_​year
• m_​020_​build_​model
• m_​050_​make_​new_​prediction
• Show all 6 workflows

Installation

To use this node in KNIME, install KNIME Extension for Big Data File Formats from the following update site:

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.