Icon

03 Instructions

Instructions to deploy a data transformation workflow into production on KNIME Business Hub using the simple deployment of the CDDS extension and perform custom tests during the validation

Learning objective: Learn how to deploy a data transformation workflow into production on KNIME Business Hub using the simple deployment of the CDDS extension and perform custom tests during the validation


You'll find the instructions to the exercises in the yellow annotations.

Session 3 - ETL and ELT; Data Pipelines Validation and Deployment Automation

Exercise 03 CDDS Simple deployment with custom validation

Warning - be considerate of other learners' projects and common CDDS spaces and workflows

You have learned that the CDDS extension consists of the workflows and components and can be easily customized. However, the CDDS environments you have access to are also used by other course learners. Therefore, we kindly ask you not to change any of the CDDS spaces (e.g., names), its internal workflows (such as Controller and Trigger workflows), and its deployments. Besides, make sure not to overwrite the work of other learners and name your projects with unique names.

Follow the exercise instructions to move your project from the CDDS Development environment to the CDDS Production environment. This will not modify the CDDS extension itself.

Step 1. CDDS user instructions

The data_transformation workflow is ready and is located in the Production folder of the project folder 03_DataTransformation_User_XX

  1. Rename the project folder from 03_DataTransformation_User_XX to 03_DataTransformation_User_<your_user_id> (find your user ID in your space name). You will collaborate with other course participants in the same CDDS spaces, therefore, your project name should be unique.

  2. !!! Additionally to the previous exercise, the project has custom testflows in the Validation folder within the project folder (and a data folder to store the golden tables)

  3. Upload the project folder to the Development space of the CDDS extension on KNIME Business Hub

  4. On your profile page, open the Data Apps Portal:

    • In the category CDDS - KNIME Training*, open the CDDS User Data App

  5. Select your project and submit it for validation

    • The automated process should succeed. Now you need to get a manual approval of the CDDS admin**

    • Note that automated validation process now included not only the standard CDDS validation but also your custom testflows


* Make sure to open the data app from the correct category, otherwise you won't be able to proceed.

** In this course you learn and play the role of both the CDDS user and the CDDS admin

Step 2. CDDS admin instructions

  1. On your profile page, open the Data Apps Portal:

    • In the category CDDS - KNIME Training, open the CDDS Admin Data App

  2. Approve the validation of your project submitted for validation. The project will move to the Production space.

Nodes

  • No nodes found

Extensions

  • No modules found

Links