0 ×

Spark to Parquet

KNIME Extension for Apache Spark core infrastructure version 2.3.0.v201807052104 by KNIME AG, Zurich, Switzerland

Converts an incoming Spark DataFrame/RDD into a parquet file.

Notice: This feature requires at least Apache Spark 1.5.

Options

Save mode
How to handle existing data.
Partitions
Overwrite default partition count. This can be useful to reduce output file count to e.g. one file.
Warning: This might result in serious performance issues on huge data sets. Use with caution!
See Spark documentation for more informations.

Input Ports

Spark compatible connection (HDFS, WebHDFS, HttpFS, S3, Blob Storage, ...)
Spark DataFrame/RDD

Update Site

To use this node in KNIME, install KNIME Extension for Apache Spark core infrastructure from the following update site:

Wait a sec! You want to explore and install nodes even faster? We highly recommend our NodePit for KNIME extension for your KNIME Analytics Platform.