Icon

02 Data Cleaning

02 Data Cleaning - Exercise

This workflow shows a hands-on exercise in the L1-DW KNIME Analytics Platform for Data Wranglers: Basics course

Task 1: Filter rows1. Read the population, life expectancy, and travel advisory data by executing the provided reader nodes2. Filter the population data to countries in Europe3. Filter the life expectancy data to countries/regions where the overall life expectancy is at least 80 years4. Filter the travel advisory data to the safest countries (Level 1: Exercise normal precautions) Task 2: Filter columns1. Read the life expectancy data from the SQLite database by executing the provided workflow2. Exclude the Rank column- Manually- By including only string and double type columns Task 3: Manipulate strings1. Read the travel advisories data by executing the provided CSV Reader node2. Replace the colons in the Level column by hyphen like this: "Level 1- Exercise normal precautions"3. Extract the risk levels as numbers into a separate column. You can use, for example, the substr() function.4. Complete the tasks above with the Column Expressions node Task 4: Evaluate mathematical expressions and apply rules1. Read the population data by executing the provided Excel Reader node2. Create a new column "Change" by subtracting the population values in 2018 from the population values in 20193. Convert the absolute population change values into percentages: Divide them by the population values in 2018. Multiply the resultby 100.4. Create a categorical column with two values "increasing"/"decreasing" based on whether the change is positive or negative Demographics.sqliteLifeExpectancyExtract numericrisk level into a separate columndemographics.xlsx(population)demographics.xlsx( life_expectancy)Convert change topercentageAdd Direction columnbased on +/- changeThe same tasks as aboveoverall life expectancy >=80Countries withLevel 1: Exercise normal precautionsEuropeRemove Rank manuallyRemove Rank by column typetravel_advidories.csvReplace :by -travel_advidories.csvdemographics.xlsx(population)Create ChangecolumnSQLite Connector DB Table Selector String Manipulation Excel Reader Excel Reader Math Formula Rule Engine Column Expressions Row Filter Row Filter Row Filter DB Reader Column Filter Column Filter CSV Reader String Manipulation CSV Reader Excel Reader Math Formula Task 1: Filter rows1. Read the population, life expectancy, and travel advisory data by executing the provided reader nodes2. Filter the population data to countries in Europe3. Filter the life expectancy data to countries/regions where the overall life expectancy is at least 80 years4. Filter the travel advisory data to the safest countries (Level 1: Exercise normal precautions) Task 2: Filter columns1. Read the life expectancy data from the SQLite database by executing the provided workflow2. Exclude the Rank column- Manually- By including only string and double type columns Task 3: Manipulate strings1. Read the travel advisories data by executing the provided CSV Reader node2. Replace the colons in the Level column by hyphen like this: "Level 1- Exercise normal precautions"3. Extract the risk levels as numbers into a separate column. You can use, for example, the substr() function.4. Complete the tasks above with the Column Expressions node Task 4: Evaluate mathematical expressions and apply rules1. Read the population data by executing the provided Excel Reader node2. Create a new column "Change" by subtracting the population values in 2018 from the population values in 20193. Convert the absolute population change values into percentages: Divide them by the population values in 2018. Multiply the resultby 100.4. Create a categorical column with two values "increasing"/"decreasing" based on whether the change is positive or negative Demographics.sqliteLifeExpectancyExtract numericrisk level into a separate columndemographics.xlsx(population)demographics.xlsx( life_expectancy)Convert change topercentageAdd Direction columnbased on +/- changeThe same tasks as aboveoverall life expectancy >=80Countries withLevel 1: Exercise normal precautionsEuropeRemove Rank manuallyRemove Rank by column typetravel_advidories.csvReplace :by -travel_advidories.csvdemographics.xlsx(population)Create ChangecolumnSQLite Connector DB Table Selector String Manipulation Excel Reader Excel Reader Math Formula Rule Engine Column Expressions Row Filter Row Filter Row Filter DB Reader Column Filter Column Filter CSV Reader String Manipulation CSV Reader Excel Reader Math Formula

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Maarit Laukkanen
Created at: 2020-04-20
On NodePit since: 2023-02-18
Last update: 2024-11-21
Created with KNIME version: v4.7.1
Tags: educationl1-dw

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!