02_​HDFS_​and_​File_​Handling_​Example

0 ×

This workflow demonstrates the HDFS file handling capabilites using the file handling nodes in conjunction with an HDFS connection.

To run this workflow on a remote cluster, use an HDFS Connection node (available in the KNIME Big Data Connectors Extension) in place of the Create Local Big Data Environment node.

Requirements:
- KNIME File Handling Nodes
- KNIME Big Data Connectors Extension
- KNIME Extension for Local Big Data Environments

Setup:
The directory /tmp needs to exist in the HDFS file system and the user needs to have read/write rights to it.

Nodes

• Create Temp Dir2 ×
• Data Generator2 ×
• Java Edit Variable (simple)2 ×
• Table Row to Variable2 ×
• Transfer Files2 ×
• Show all 24 nodes

Extensions

• FeatureKNIME Base nodes
• FeatureKNIME Basic File System Connectors
• FeatureKNIME Extension for Apache Spark
• FeatureKNIME Extension for Apache Spark (legacy)
• FeatureKNIME Javasnippet
• Show all 6 modules

Links

• No links available