Icon

Part 4 - Best practices to productionize data pipelines

This directory contains 2 workflows.

Icon01 Data validation & Statistics Process Control - Exercise 

This workflow implements the input data validation and checks: - Whether input data table is empty, - Whether input data has all the required columns, - […]

Icon02 Production data pipeline with data validation & logging - Exercise 

This workflow: - Reads and validates the data from real data sources, - Calls the developed and tested Data Transformation workflow to transform the raw […]