Parquet Reader

Reader for Parquet files. It reads either single files or all files in a given directory.

Options

Input

The file or directory to read.

Input Type Mapping

Change the Parquet to KNIME type mapping configuration for subsequent nodes by selecting a KNIME type to the given Parquet Type. The dialog allows you to add new or change existing type mapping rules.

Mapping by Name

Columns that match the given name (or regular expression) and Parquet type will be mapped to the specified KNIME type.

Mapping by Type

Columns that match the given Parquet type will be mapped to the specified KNIME type.

Input Ports

Optional port for a remote connection.

Output Ports

Data table containing the data of the Parquet file.

Best Friends (Incoming)

• Amazon S3 Connection (17 %) 
• Parquet Writer (16 %) Streamable
• Table Row To Variable Loop Start (12 %) 
• Amazon S3 File Picker (9 %) 
• HDFS Connection (8 %) 
• Show all 32 recommendations

Best Friends (Outgoing)

• Loop End (10 %) 
• Column Filter (8 %) Streamable
• Row Filter (8 %) Streamable
• GroupBy (8 %) 
• Joiner (6 %) 
• Show all 94 recommendations

Workflows

• 01_​Flight_​Delay_​Statistics (KNIME Hub) 
• 01_​Flight_​Delay_​Statistics_​Impala (KNIME Hub) 
• 06_​Connecting_​to_​Databricks (KNIME Hub) 
• kn_​example_​python_​import_​module (KNIME Hub) 
• kn_​example_​python_​read_​parquet_​file (KNIME Hub) 
• Show all 19 workflows

Installation

To use this node in KNIME, install KNIME Extension for Big Data File Formats from the following update site:

A zipped version of the software site can be downloaded here.

You don't know what to do with this link? Read our NodePit Product and Node Installation Guide that explains you in detail how to install nodes to your KNIME Analytics Platform.

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.