Icon

01.1_​Extract_​S3_​data

01.1_Extract_S3_data_exercise

The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. New Europe customer data comes from Amazon S3.

We access, validate, prepare, and blend the data, anonymize it, and insert it to the database table "customers". We export the final status of the workflow. In the case some processes fail, we notify responsible people via an automated email.




Extract Transform Load ExercisesAll the tasks can be found in the yellow annotations and the yellow components.Make sure you have executed the 00_Setup_PostgreSQL_Database workflow before running this workflow. Session 1 ETL Processing IExercise 01.1 Extract S3 data 1 Access from the Amazon S3data lake, validate, clean, andstandardize the Europecustomers data1. Provide the Access Key ID and Secret Key2. Open the component to find the instructions Data AccessEurope Customers Extract Transform Load ExercisesAll the tasks can be found in the yellow annotations and the yellow components.Make sure you have executed the 00_Setup_PostgreSQL_Database workflow before running this workflow. Session 1 ETL Processing IExercise 01.1 Extract S3 data 1 Access from the Amazon S3data lake, validate, clean, andstandardize the Europecustomers data1. Provide the Access Key ID and Secret Key2. Open the component to find the instructions Data AccessEurope Customers

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Lada.Rudnitckaia
Created at: 2021-10-07
On NodePit since: 2023-04-06
Last update: 2024-04-27
Created with KNIME version: v4.7.1
Tags: Best practicesData engineerData engineeringEducation

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!