Icon

Session_​3_​ELT_​on_​Big_​Data

4 workflows in this folder and its subfolders

Icon
03.0_​Setup_​Local_​Big_​Data_​Environment_​-_​Exercise

September 2021 · This workflow sets up a local big data environment for the next exercise. It creates a local big data environment and loads the usage data into it. TAGS: Education,Data engineering,Data engineer,Best practices,big data,ELT

Icon
03.1_​In-database&Spark_​processing_​-_​Exercise

September 2021 · Various data are collected, e.g., session start, duration, # clicks, etc., as well as the session satisfaction score (optional) The company calculates averaged statistics for each customer, e.g., total # visits, average satisfaction, etc., and updates the "statistics" table in different locations Se…

Icon
03.2_​Missing_​value_​imputation_​on_​Spark_​-_​Exercise

September 2021 · Various data are collected, e.g., session start, duration, # clicks, etc., as well as the session satisfaction score (optional) The company calculates averaged statistics for each customer, e.g., total # visits, average satisfaction, etc., and updates the "statistics" table in different locations Se…

Icon
03.3_​Aggregation_​on&Export_​from_​Spark_​-_​Exercise

September 2021 · Various data are collected, e.g., session start, duration, # clicks, etc., as well as the session satisfaction score (optional) The company calculates averaged statistics for each customer, e.g., total # visits, average satisfaction, etc., and updates the "statistics" table in different locations Se…