File Splitter for Cluster

The KNIME cluster extension can distribute tables across a cluster. To enable the distribution of files, this node splits a given file into parts and creates a table with file store cells that reference the parts. When the table is distributed the files are taken along and can be processed in parallel on different cluster nodes. Use the "Port to File Cells" node to send back result files.

Options

Number of parts
The number of parts to split the files into. Parts are distributed across available cluster nodes.
Splitter
The splitter to use.

Input Ports

Icon
The file to split

Output Ports

Icon
Table containing references to the file parts

Popular Predecessors

Popular Successors

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension Generic Workflow Nodes for KNIME from the below update site following our NodePit Product and Node Installation Guide:

v5.1

A zipped version of the software site can be downloaded here.

Plugin provider: Freie Universitaet Berlin, Universitaet Tuebingen, and the GenericWorkflowNodes Team
Plugin version: 1.1.0.v202305081408
On NodePit since: 2023-07-15
Last update: 2023-09-22
KNIME versions: v5.1, v4.7, v4.6, v4.5, v4.4, v4.3, v4.2, v4.1, v4.0, v3.7, v3.6

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!