Avro to Spark

This Node Is Deprecated — This version of the node has been replaced with a new and improved version. The old version is kept for backwards-compatibility, but for all new workflows we suggest to use the version linked below.
Go to Suggested ReplacementAvro to Spark
Creates a Spark DataFrame/RDD from given Avro file.

Notice: This feature requires at least Apache Spark 1.5.

Options

Driver
Upload data source driver or depend on cluster side provided driver.

Input Ports

Icon
Spark compatible connection (HDFS, WebHDFS, HttpFS, S3, Blob Storage, ...)
Icon
Optional Spark context. If not connected a context is created based on the settings in the Spark preferences page.

Output Ports

Icon
Spark DataFrame/RDD

Popular Predecessors

  • No recommendations found

Popular Successors

  • No recommendations found

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.