Icon

01 Development data pipeline - Integrated deployment - Exercise

This workflow reads a sample of restaurant orders data, cleans and transforms it, and loads the transformed data to the development database. Besides, it captures the data transformation segment and saves it as a separate Data Transformation workflow.
Step 1. Capture the workflow segment using Integrated Deployment

  1. Capture the Data Transformationsegment of the workflow

    • After reading the data, add the Capture Workflow Start node to begin the workflow capturing process

    • Use the Capture Workflow End node after the Summarize TimeStamp-Hourcomponent to end the capturing process


Transform

Part 1 - Preparing a data pipeline for deployment

Exercise 01 Development data pipeline - Integrated deployment

Learning objective: In this exercise you'll learn how to use integrated deployment to capture data transformation segment of a development data pipeline workflow and how to upload and version an automatically created data transformation workflow on KNIME Business Hub.


Workflow description: This workflow reads a sample of restaurant orders data, cleans and transforms it, and loads the transformed data to the development database. Besides, it captures the data transformation segment and saves it as a separate Data Transformation workflow directly on KNIME Business Hub.


You'll find the instructions to the exercises in the yellow annotations.

Extract a sample

Step 2. Save the Data Transformation workflow


  1. In the Workflow Writer node:

    • Use the workflow relative path to write to /00 Deployment workflows folder

    • Enable overwriting of the workflow

    • Use custom workflow name: Data_Transformation

    • In the Inputs and outputs tab:

      • Select Workflow Service Input and Workflow Service Output nodes for the input and output nodes to be added automatically

  2. Explore the automatically created workflow


"Price" Column to Number
String to Number
Workflow Writer
"Table ID" Column to Number
String to Number
by time, restaurant
Sorter
Capture Workflow Start
Capture Workflow End
Date&Time
String to Date&Time (deprecated)
Remove Duplicates
Duplicate Row Filter
Filter relevant cols
Column Filter
Recent data fromlast week
CSV Reader
Summarize Timestamp-Hour

Nodes

Extensions

Links