Parquet Reader

Reader for Parquet files. It reads either single files or all files in a given directory.

Options

Input

The file or directory to read.

Input Type Mapping

Change the Parquet to KNIME type mapping configuration for subsequent nodes by selecting a KNIME type to the given Parquet Type. The dialog allows you to add new or change existing type mapping rules.

Mapping by Name

Columns that match the given name (or regular expression) and Parquet type will be mapped to the specified KNIME type.

Mapping by Type

Columns that match the given Parquet type will be mapped to the specified KNIME type.

Input Ports

Optional port for a remote connection.

Output Ports

Data table containing the data of the Parquet file.

Best Friends (Incoming)

• Amazon S3 Connection (43 %) 
• Parquet Writer (21 %) Streamable
• Table Row To Variable Loop Start (14 %) 
• String Manipulation (Variable) (7 %) 
• HDFS Connection (7 %) 
• Show all 6 recommendations

Best Friends (Outgoing)

• Row Filter (25 %) Streamable
• Column Filter (13 %) Streamable
• Parquet Writer (13 %) Streamable
• GroupBy (8 %) 
• R View (Table) (8 %) 
• Show all 12 recommendations

Workflows

• 01_​Flight_​Delay_​Statistics_​Impala (KNIME Hub) 
• 06_​Connecting_​to_​Databricks (KNIME Hub) 
• 06_​Connecting_​to_​Databricks (KNIME Hub) 
• kn_​example_​python_​read_​parquet_​file (KNIME Hub) 
• kn_​example_​r_​read_​parquet_​file (KNIME Hub) 
• Show all 17 workflows

Installation

To use this node in KNIME, install KNIME Extension for Big Data File Formats from the following update site:

A zipped version of the software site can be downloaded here. Read our FAQs to get instructions about how to install nodes from a zipped update site.

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.