Icon

02. Data Manipulation

Data Manipulation

Solution to "Manipulation Data" exercise for basic Life Science User Training
- Concatenate data from two different sources
- Modify String values
- Join data from multiple tables
- Remove duplicates in the data

URL: Advaced ETL Functionalities and Machine Learning based Pre-Processing https://youtu.be/IEAsUTN8q68
URL: Joining Data Tables https://youtu.be/6BigLM6vbhs
URL: Joining Data Tables - Inner Join https://youtu.be/9uV99ByH-TA
URL: Concatenate https://youtu.be/VzH2lHbDAg0
URL: Concatenate Node https://youtu.be/ku6SyEZ1Pv8
URL: Data Manipulation: Numbers, Strings, and Rules https://youtu.be/mJrBXmLQ4ko
URL: Slides for KNIME Analytics Platform Course (L1-LS) https://www.knime.com/form/material-download-registration

Task 1: Remove all missing values in the EC50 column.

Task 2: Concatenate malariahts_experiment hits and no-hits data into one single table

Task 3: Use String Manipulation to ensure that all entries of the Sample column are using UPPERCASE letters.


Task 4: Join molecule properties (from SDF Reader) with other features (from Table Reader) by Sample name

Task 5: Join all data together by Sample name

Activity I - Data Cleaning, Transforming and Aggregating

Task 1: Use the Rule Engine node to add the following tags in a new column named REOS
- "MW" if AMW is smaller than 100 or greater than 700
- "Complexity" if NumHeavyAtoms is smaller than 5 or greater than 50 or NumRotatableBonds is greater or equal to 12
- "HBond" if NumHBD is greater than 5 or NumHBA is greater than 10
- "logP" if SlogP is smaller -5 or greater than 7.5
- "Pass" for all other cases

Activity II: Data Manipulation (Optional)

Task 7: Calculate Mean values of SLogP, NumAtoms and AMW for the two groups in the dataset: TRUE / FALSE

Task 2: Use the Table Manipulator node to
- move the molecule column to the front (as first column of the table)
- remove the columns (Pf3D7_ps_green, Pf3D7_ps_red, ExactMW)
- rename the column AMW to "Average Molecular Weight (AWM)

Task 6: Keep only rows with Pf3D7_ps_green having values between 0 - 150

malariahts_molecules_feature.table
Table Reader
malariahts_joined.table
Table Reader
malariahts_experiment_hits.csv
CSV Reader
malariahts_experiment_no-hits.xlsx
Excel Reader
malariahts_molecules.sdf
SDF Reader

Nodes

Extensions

Links