Icon

01.2_​Extract_​WebService_​data&Blend

01.2_Extract_WebService_data&Blend_exercise

The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. New Europe customer data comes from Amazon S3.

We access, validate, prepare, and blend the data, anonymize it, and insert it to the database table "customers". We export the final status of the workflow. In the case some processes fail, we notify responsible people via an automated email.



Extract Transform Load ExercisesAll the tasks can be found in the yellow annotations and the yellow components.Make sure you have executed the 00_Setup_PostgreSQL_Database workflow before running this workflow. Session 1 ETL Processing IExercise 01.2 Extract WebService data & Blend 2 Access from the web service,validate, clean, and standardizethe US customers data 1. Provide the username and password to theweb service.2. Open the component to find the instructions Blend the data fromdifferent sources Concatenate Data AccessUS Customers Data AccessEurope Customers Extract Transform Load ExercisesAll the tasks can be found in the yellow annotations and the yellow components.Make sure you have executed the 00_Setup_PostgreSQL_Database workflow before running this workflow. Session 1 ETL Processing IExercise 01.2 Extract WebService data & Blend 2 Access from the web service,validate, clean, and standardizethe US customers data 1. Provide the username and password to theweb service.2. Open the component to find the instructions Blend the data fromdifferent sources Concatenate Data AccessUS Customers Data AccessEurope Customers

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Lada.Rudnitckaia
Created at: 2021-10-07
On NodePit since: 2023-04-06
Last update: 2024-04-27
Created with KNIME version: v4.7.1
Tags: Best practicesData engineerData engineeringEducation

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!