This node is currently not available in KNIME v5.2 — instead we’re showing this page for KNIME v4.2. You can use the version menu in the title bar to permanently switch your preferred version. This will also show the link to the update site.

Spark to CSV

Writes a Spark DataFrame/RDD into a CSV file. See CSV Data Source documentation for more information.

Notice: This feature requires at least Apache Spark 1.5.

Options

Save mode: How to handle existing data.
Driver: Upload data source driver or depend on cluster side provided driver.
Partitions: Overwrite default partition count. This can be useful to reduce output file count to e.g. one file.
Warning: This might result in serious performance issues on huge data sets. Use with caution!
See Spark documentation for more informations.
Header: The header will be written at the first line.
Delimiter: Character used as delimiter between columns (supports escape sequences, e.g. \t or \u0123).
Quote character: Quote character (delimiters inside quotes are ignored).
Escape character: Escape character (escaped quote characters are ignored).
Null value: Specifies a string that indicates a null value, nulls in the DataFrame will be written as this string.
Date format: Specifies a string that indicates the date format to use when reading dates or timestamps. Custom date formats follow the formats at java.text.SimpleDateFormat. This applies to both DateType and TimestampType. By default, it is null which means trying to parse times and date by java.sql.Timestamp.valueOf() and java.sql.Date.valueOf().
codec: Compression codec to use when saving to file.
Quote mode: When to quote fields (ALL, MINIMAL (default), NON_NUMERIC, NONE), see Quote Modes.

Input Ports

: Spark compatible connection (HDFS, WebHDFS, HttpFS, S3, Blob Storage, ...)
: Spark DataFrame/RDD

Output Ports

This node has no output ports

Popular Predecessors

Popular Successors

Views

This node has no views

Workflows

No workflows found

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension KNIME Extension for Apache Spark from the below update site following our NodePit Product and Node Installation Guide:

v4.2

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland

Plugin version: 4.2.0.v202008241922

On NodePit since: 2020-07-15

Last update: 2024-04-14

KNIME versions: From v3.6 to v4.2

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!