This node is currently not available in KNIME v5.3 — instead we’re showing this page for KNIME v4.2. You can use the version menu in the title bar to permanently switch your preferred version. This will also show the link to the update site.

JSON to Spark

Creates a Spark DataFrame/RDD from given JSON file. See Jackson JSON Parser documentation for more information.

Notice: This feature requires at least Apache Spark 1.5.

Options

Sampling ratio

Infer the type of a collection of JSON records in three stages:

Sample given amount of records and infer the type.
Merge types by choosing the lowest type necessary to cover equal keys.
Replace any remaining null fields with string, the top type.

Primitives

Convert primitives into Strings.

Comments

Allow comments.

Fieldnames

Allow unquoted fieldnames.

Quotes

Feature that determines whether parser will allow use of single quotes (apostrophe, character '\'') for quoting Strings (names and String values).

Numerics

Allow numeric leading zeros: Feature that determines whether parser will allow JSON integral numbers to start with additional (ignorable) zeroes (like: 000001).
Allow non numeric numbers: Feature that allows parser to recognize set of "Not-a-Number" (NaN) tokens as legal floating number values (similar to how many other data formats and programming language source code allows it). Supported tokens: INF, -INF, Infinity, -Infinity and NaN.

Input Ports

: Spark compatible connection (HDFS, WebHDFS, HttpFS, S3, Blob Storage, ...)
: Required Spark context.

Output Ports

: Spark DataFrame/RDD

Popular Predecessors

Popular Successors

Views

This node has no views

Workflows

No workflows found

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension KNIME Extension for Apache Spark from the below update site following our NodePit Product and Node Installation Guide:

v4.2

A zipped version of the software site can be downloaded here.

Plugin provider: KNIME AG, Zurich, Switzerland

Plugin version: 4.2.0.v202008241922

On NodePit since: 2020-07-15

Last update: 2024-11-12

KNIME versions: From v3.6 to v4.2

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!