Icon

01_​Fault_​Tolerant_​Workflow_​Orchestration

Fault tolerant Workflow orchestration

This example shows how to orchestrate the fault tolerant execution of multiple local KNIME Workflows. All Workflows in the batch are repeatedly executed until they succeed or reach a user-defined maximum number of fails.

Setup Workflow Metadata Loop over all Workflows defined in Metadata from previous section Recursive Loop for multiple Workflow execution on fail dependingon parameter "Max_Iterations". Fault tolerant execution of Multiple WorkflowsThis workflow shows how to execute multiple local KNIME Workflows with fault tolerant error handling.In Order to execute multiple Workflows, KNIME provides the "Execute local workflow" Node. However, sometimes a Workflow can fail, especially if the Workflow depends on theavailibility of some kind of external service or maybe the Workflow to be called is not available during execution. We use the Try and Catch Nodes to process failing Workflows and aRecursive Loop to re-run them until the defined maximum number of executions is reached. In any case, each Workflow will produce a row with information such as number of timesthe workflow was executed and the execution time for reporting as well as the final status and a status message. Input Table with Workflow Orchestration Metadata Inner Loop for multiple Workflow execution on ErrorEnd of Inner LoopAdd helper variable for Rule-based Row Splitter Outer Loop Iterate Workflow Metadata Row as Variablecreate Rows from Iteration VariablesExecutes Workflows based on Metadata InputEnd of outer Loop(Collection of batch execution report data) Table Creator RecursiveLoop Start Recursive Loop End Math Formula(Variable) Table Row ToVariable Loop Start Variable to TableRow (deprecated) Local WorkflowExecution Loop End Setup Workflow Metadata Loop over all Workflows defined in Metadata from previous section Recursive Loop for multiple Workflow execution on fail dependingon parameter "Max_Iterations". Fault tolerant execution of Multiple WorkflowsThis workflow shows how to execute multiple local KNIME Workflows with fault tolerant error handling.In Order to execute multiple Workflows, KNIME provides the "Execute local workflow" Node. However, sometimes a Workflow can fail, especially if the Workflow depends on theavailibility of some kind of external service or maybe the Workflow to be called is not available during execution. We use the Try and Catch Nodes to process failing Workflows and aRecursive Loop to re-run them until the defined maximum number of executions is reached. In any case, each Workflow will produce a row with information such as number of timesthe workflow was executed and the execution time for reporting as well as the final status and a status message. Input Table with Workflow Orchestration Metadata Inner Loop for multiple Workflow execution on ErrorEnd of Inner LoopAdd helper variable for Rule-based Row Splitter Outer Loop Iterate Workflow Metadata Row as Variablecreate Rows from Iteration VariablesExecutes Workflows based on Metadata InputEnd of outer Loop(Collection of batch execution report data) Table Creator RecursiveLoop Start Recursive Loop End Math Formula(Variable) Table Row ToVariable Loop Start Variable to TableRow (deprecated) Local WorkflowExecution Loop End

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: nico
Created at: 2017-03-21
On NodePit since: 2019-12-26
Last update: 2024-11-23
Created with KNIME version: v4.1.0

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!