Icon

02 Data Cleaning

02 Data Cleaning - Exercise

This workflow shows a hands-on exercise in the L1-DW KNIME Analytics Platform for Data Wranglers: Basics course

Task 1: Filter rows1. Read the population, life expectancy, and travel advisory data by executing the provided reader nodes2. Filter the population data to countries in Europe3. Filter the life expectancy data to countries/regions where the overall life expectancy is at least 80 years4. Filter the travel advisory data to the safest countries (Level 1: Exercise normal precautions) Task 2: Filter columns1. Read the life expectancy data from the SQLite database by executing the provided workflow2. Exclude the Rank column- Manually- By including only string and double type columns Task 3: Manipulate strings1. Read the travel advisories data by executing the provided CSV Reader node2. Replace the colons in the Level column by hyphen like this: "Level 1- Exercise normal precautions"3. Extract the risk levels as numbers into a separate column. You can use, for example, the substr() function.4. Complete the tasks above with the Column Expressions node Task 4: Evaluate mathematical expressions and apply rules1. Read the population data by executing the provided Excel Reader node2. Create a new column "Change" by subtracting the population values in 2018 from the population values in 20193. Convert the absolute population change values into percentages: Divide them by the population values in 2018. Multiply the resultby 100.4. Create a categorical column with two values "increasing"/"decreasing" based on whether the change is positive or negative Demographics.sqliteLifeExpectancydemographics.xlsx(population)demographics.xlsx( life_expectancy)demographics.xlsx(population)travel_advidories.csvtravel_advidories.csvEuropeLife expectancy >= 80Remove by Column FilterLevel 1 SafetyReplace : with -Remove Rank ManuallyExtract Numeric risk level to a new columnStep 4Change Column CreatedChange converted to percentagePositive/Negative ChangeSQLite Connector DB Table Selector Excel Reader Excel Reader Excel Reader DB Reader CSV Reader CSV Reader Row Filter Row Filter Column Filter Row Filter String Manipulation Column Filter String Manipulation Column Expressions Math Formula Math Formula Rule Engine Task 1: Filter rows1. Read the population, life expectancy, and travel advisory data by executing the provided reader nodes2. Filter the population data to countries in Europe3. Filter the life expectancy data to countries/regions where the overall life expectancy is at least 80 years4. Filter the travel advisory data to the safest countries (Level 1: Exercise normal precautions) Task 2: Filter columns1. Read the life expectancy data from the SQLite database by executing the provided workflow2. Exclude the Rank column- Manually- By including only string and double type columns Task 3: Manipulate strings1. Read the travel advisories data by executing the provided CSV Reader node2. Replace the colons in the Level column by hyphen like this: "Level 1- Exercise normal precautions"3. Extract the risk levels as numbers into a separate column. You can use, for example, the substr() function.4. Complete the tasks above with the Column Expressions node Task 4: Evaluate mathematical expressions and apply rules1. Read the population data by executing the provided Excel Reader node2. Create a new column "Change" by subtracting the population values in 2018 from the population values in 20193. Convert the absolute population change values into percentages: Divide them by the population values in 2018. Multiply the resultby 100.4. Create a categorical column with two values "increasing"/"decreasing" based on whether the change is positive or negative Demographics.sqliteLifeExpectancydemographics.xlsx(population)demographics.xlsx( life_expectancy)demographics.xlsx(population)travel_advidories.csvtravel_advidories.csvEuropeLife expectancy >= 80Remove by Column FilterLevel 1 SafetyReplace : with -Remove Rank ManuallyExtract Numeric risk level to a new columnStep 4Change Column CreatedChange converted to percentagePositive/Negative ChangeSQLite Connector DB Table Selector Excel Reader Excel Reader Excel Reader DB Reader CSV Reader CSV Reader Row Filter Row Filter Column Filter Row Filter String Manipulation Column Filter String Manipulation Column Expressions Math Formula Math Formula Rule Engine

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Maarit Laukkanen
Created at: 2020-04-20
On NodePit since: 2023-01-30
Last update: 2024-11-21
Created with KNIME version: v4.7.0
Tags: educationl1-dw

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!