Icon

5. Chunk Loop

<p><strong>Chunk Loop</strong></p><p>This workflow implements an example of a chunk loop using the <em>Chunk Loop Start</em> node. The chunk loop processes the entire data table once, however, it processes the rows in pre-defined groups (so-called <em>chunks</em>). Processing smaller chunks of data at a time speeds up the execution time. The chunk size (i.e., the number of rows to be processed per iteration) can be defined in the <em>Chunk Loop Start</em> node.</p><p>The goal of this workflow is similar to the workflow "1. Counting Loop": Generate fake data with 3 clusters over 2 coordinates (x, y) and then shift the x-values (Universe_0_0) by adding the current iteration number to its value (e.g., x+0 in the first iteration, x+1 in the second iteration, etc.).</p>

Workflow: Chunk Loop


This workflow implements an example of a chunk loop using the Chunk Loop Start node. The chunk loop processes the entire data table once, however, it processes the rows in pre-defined groups (so-called chunks). Processing smaller chunks of data at a time speeds up the execution time. The chunk size (i.e., the number of rows to be processed per iteration) can be defined in the Chunk Loop Start node.

The goal of this workflow is similar to the workflow "1. Counting Loop": Generate fake data with 3 clusters over 2 coordinates (x, y) and then shift the x-values (Universe_0_0) by adding the current iteration number to its value (e.g., x+0 in the first iteration, x+1 in the second iteration, etc.).

Loop body

Generating data

3 clusters, 2 coordinates (Universe_0_0, Universe_0_1)

Visualizing data

Visualizing data

Check data range for each group of data (Iter #)

Define number of chunksor rows per chunk
Chunk Loop Start
Color by clusters
Color Manager
Visualize original data
Scatter Plot
Concatenate dataof each iteration
Loop End
3 clusters 2 coordinates
Data Generator
Visualize x-shifted data
Scatter Plot
Shift values andreplace original values
Expression

Nodes

Extensions

Links