Icon

Integrated deployment for ETL

The workflow demonstrates how Integrated Deployment concept can be applied for ETL use cse. The workflow is based on educational example for L1 course.
The demo shows how to combine different type of inputs and outputs to build a production pipeline.

Activity I - Concatenate web activity data from old and newsystems. Workflow in development Part 1 Part 2 Part 3 Part 4 Stacking parts Workflow in production Numeric sentimentscoresChange product valuesto lower caseWebActivity.sqliteWebActivityRemove duplicaterowsexclude Sentiment Ratingand Web ActivitySentiment Rating+Sentiment DescriptionDemographicsand Historyfrom SAS fileProduct DataProduct DataOld Web DataCombine oldand new systemSentiment Evaluation from KNIMEFilter byWebActivityAdd sentiment analysisPart 1Part 1Part 2Part 2Part 3Part 3Part 1Part 2Save finalworkflowParts 1,2Part 3Part 4Part 4Parts 1,2,3Part 4Run deployedworkflowProduct chartOld Web DataWebActivity.sqliteWebActivitySentiment Rating+Sentiment DescriptionDemographicsand Historyfrom SAS fileProduct DataProduct DataRead deployedworkflowNode 298Add Demographics dataadd product dataCell Replacer String Manipulation SQLite Connector DB Table Selector DuplicateRow Filter Column Filter CSV Reader CSV Reader H2 Connector DB Table Selector DB Reader DB Table Selector DB Concatenate DB Reader DB Table Selector DB Row Filter Web Activity FilterConfiguration DB Reader Joiner CaptureWorkflow Start CaptureWorkflow End CaptureWorkflow Start CaptureWorkflow End CaptureWorkflow Start CaptureWorkflow End Workflow Combiner Workflow Writer Workflow Combiner CaptureWorkflow Start CaptureWorkflow End Workflow Combiner Workflow Executor Bar Chart DB Table Selector SQLite Connector DB Table Selector CSV Reader CSV Reader H2 Connector DB Table Selector Workflow Reader Web Activity FilterConfiguration Joiner Joiner Activity I - Concatenate web activity data from old and newsystems. Workflow in development Part 1 Part 2 Part 3 Part 4 Stacking parts Workflow in production Numeric sentimentscoresChange product valuesto lower caseWebActivity.sqliteWebActivityRemove duplicaterowsexclude Sentiment Ratingand Web ActivitySentiment Rating+Sentiment DescriptionDemographicsand Historyfrom SAS fileProduct DataProduct DataOld Web DataCombine oldand new systemSentiment Evaluation from KNIMEFilter byWebActivityAdd sentiment analysisPart 1Part 1Part 2Part 2Part 3Part 3Part 1Part 2Save finalworkflowParts 1,2Part 3Part 4Part 4Parts 1,2,3Part 4Run deployedworkflowProduct chartOld Web DataWebActivity.sqliteWebActivitySentiment Rating+Sentiment DescriptionDemographicsand Historyfrom SAS fileProduct DataProduct DataRead deployedworkflowNode 298Add Demographics dataadd product dataCell Replacer String Manipulation SQLite Connector DB Table Selector DuplicateRow Filter Column Filter CSV Reader CSV Reader H2 Connector DB Table Selector DB Reader DB Table Selector DB Concatenate DB Reader DB Table Selector DB Row Filter Web Activity FilterConfiguration DB Reader Joiner CaptureWorkflow Start CaptureWorkflow End CaptureWorkflow Start CaptureWorkflow End CaptureWorkflow Start CaptureWorkflow End Workflow Combiner Workflow Writer Workflow Combiner CaptureWorkflow Start CaptureWorkflow End Workflow Combiner Workflow Executor Bar Chart DB Table Selector SQLite Connector DB Table Selector CSV Reader CSV Reader H2 Connector DB Table Selector Workflow Reader Web Activity FilterConfiguration Joiner Joiner

Nodes

Extensions

Links