Parallel Chunk Start

Represents the start of a parallel chunked flow. Upon execution, it splits the input data into equally sized chunks and executes the body (terminated by the Parallel Chunk End) in parallel, each processing one chunk. The chunk count can be customized in the configuration dialog.

Options

Use automatic chunk count

Use a chunk count derived from the system's processor count. (To control this externally you can set the flow variable "chunkCount" equal to -1 and the setting "Use custom chunk count".)

Use custom chunk count

Specify the chunk count in the spinner.

Disable main branch

Controls if the main branch is used for computations or not. If selected, all chunks will be processed in copies of the body and the body itself will be inactive.

Views

This node has no views

Workflows

• 01_Guided_Analytics_for_ML_AutomationKNIME Hub
• 01_Guided_Analytics_for_ML_AutomationKNIME Hub
• 01_Guided_Analytics_for_ML_AutomationKNIME Hub
• 01_Guided_Analytics_for_ML_AutomationKNIME Hub
• 01_Guided_Analytics_for_ML_AutomationKNIME Hub
• Show all 131 workflows

Links

• multiport support for Parallel Chunk Loopsby lars20070 on 2018-06-29

  forum.knime.com/p/44558
• Parallel execution in Knimeby armingrudd on 2019-09-25

  forum.knime.com/p/70960
• How does KNIME process multi files?by stelfrich on 2018-11-07

  forum.knime.com/p/49647
• Help to Optimize Workflow for Processing Multiple URLsby qqilihq on 2023-11-13

  forum.knime.com/p/241526
• Processing hundreds of millions of recordsby izaychik63 on 2019-02-27

  forum.knime.com/p/55291
• Parallel Scriptby qqilihq on 2020-01-27

  forum.knime.com/p/79850
• Workaround for 403 errors?by qqilihq on 2020-05-26

  forum.knime.com/p/92453

Developers