Icon

Session_​4_​Orchestration

4 workflows in this folder and its subfolders

Icon
04.0_​Reset_​DB&Big_​Data_​Environment

September 2021 · 04.0_Reset_DB&Big_Data_Environment This workflow resets the database by overwriting the customers and statistics tables and sets up a local big data environment and loads the usage data into it. URL: L4-DE Course Slides https://www.knime.com/form/material-download-registration TAGS: Education,Data e…

Icon
04.1_​ETL_​Customers

October 2021 · 04.1_ETL_Customers_exercise The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. New Europe customer data comes from Amazon S3. We access, validate, prepare, and blend the data, anonymize it, and insert it to the database ta…

Icon
04.2_​ELT_​Usage

September 2021 · 04.2_ELT_Usage The company tracks the usage of the website and stores the information about each session. Various data are collected, e.g., session start, duration, # clicks, etc., as well as the session satisfaction score (optional) The company calculates averaged statistics for each customer, e.g.…

Icon
04.3_​Orchestration

October 2021 · 04.3 Orchestration_exercise Once the workflow the ETL on Customers data is executed successfully, i.e., customer data are accessed and anonymized, and the database table "customers" is updated, the next process - ELT on Usage data - should be triggered. In the next workflow, the usage data are acces…