Icon

Tutorial-L_​Outlier-Removal

<p>This tutorial is part of a series of tutorials on the topic of data preparation (Tutorial_G – Tutorial_O). These tutorials are included in the book, <em>Handbook of Statistical Analysis, AI, and ML Applications (Elsevier Publishers, 2025). </em>These tutorials will guide you to build KNIME workflows to perform common data preparation tasks. You can adapt these workflows easily to load and process your own datasets.</p><p>---</p><p>The publisher has graciously permitted these tutorials to be included on the KNIME Community Hub and has provided the 30% discount code <em>MATH30</em> to purchase the book from https://shop.elsevier.com/books/handbook-of-statistical-analysis/nisbet/978-0-443-15845-2.</p>

This tutorial is part of a series of tutorials on the topic of data preparation (Tutorial_G – Tutorial_O). These tutorials are included in the book, Handbook of Statistical Analysis, AI, and ML Applications (Elsevier Publishers, 2025). These tutorials will guide you to build KNIME workflows to perform common data preparation tasks. You can adapt these workflows easily to load and process your own datasets.

---

The publisher has graciously permitted these tutorials to be included on the KNIME Community Hub and has provided the 30% discount code MATH30 to purchase the book from https://shop.elsevier.com/books/handbook-of-statistical-analysis/nisbet/978-0-443-15845-2.

Tutorial L - Outlier Removal


Removal of outliers is the simplest type of data filtering. Even though sometimes outliers should be kept in the dataset as they represent natural variations in the population, such as in the case of modeling of credit risk, fraud, and other rare events, there are outliers that are problematic as they represent unnecessary or incorrect information, such as measurement errors, data entry, and processing errors or poor sampling, and should be removed. Unnecessary outliers are noise in the data and mostly can reduce the predictability of the model; therefore, their removal can not only improve the accuracy of the predictions but also produce better visualization, making it easier to identify patterns and trends.


Review Tutorial_L for more detailed instructions.

Load the file created in Tutorial_J from the Data/ directory:

Tutorial-J_DataCleaning.csv

Identify the outlier in the column HIT.

Remove all rows that are greater than the outlier.

Alternatively, use Expression node to filter out the outliers.

Write output data as CSV file to disk.

Nodes

  • No nodes found

Extensions

  • No modules found

Links