This workflow demonstrates streaming in KNIME. Streaming is only possible for a selection of nodes. To enable streaming, you simply need to combine all streamable nodes in a component. In that way, downstream nodes can already execute with chunks of data, while upstream nodes are still executing. In the configuration dialog of the component under the "Job Manager Selection" tab, you can enable "simple streaming" and define the chunk size.
To find out which nodes are streamable, you can go to your Node Repository and click on the three dots next to the search. There you can either select "Show Streamable Nodes Only" to only see the streamable node or "Show Additional Info" to see the additional infos for each node.
Required Extension:
- KNIME Streaming Execution (Beta)
- KNIME Text Processing
To use this workflow in KNIME, download it from the below URL and open it in KNIME:
Download WorkflowDeploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.
Try NodePit Runner!Do you have feedback, questions, comments about NodePit, want to support this platform, or want your own nodes or workflows listed here as well? Do you think, the search results could be improved or something is missing? Then please get in touch! Alternatively, you can send us an email to mail@nodepit.com.
Please note that this is only about NodePit. We do not provide general support for KNIME — please use the KNIME forums instead.