This node detects and treats the outliers for each of the selected columns individually by means of interquartile range (IQR).
To detect the outliers for a given column, the first and
third
quartile (Q1, Q3) is computed.
An observation is flagged an outlier if it lies
outside the range
R = [Q1 - k(IQR), Q3 + k(IQR)] with
IQR = Q3 - Q1 and k >= 0.
Setting k = 1.5 the smallest value in R corresponds,
typically, to the lower end of a boxplot's whisker and largest value
to its upper end.
Providing grouping information allows to detect outliers only
within their respective groups.
If an observation is flagged an outlier, one can either replace it by some other value or remove/retain the corresponding row.
Missing values contained in the data will be ignored, i.e., they will neither be used for the outlier computation nor will they be flagged as an outlier.
Options
Outlier Selection
General Settings
Outlier Treatment
Group Selection
Memory Policy
Output Ports
- Data table where outliers were either replaced or rows containing outliers/non-outliers were removed
- Data table holding the number of members, i.e., non-missing values and outliers as well as the lower and upper bound for each outlier groups
- Model holding the permitted interval bounds for each outlier group and the outlier treatment specifications
Popular Predecessors
- Column Filter7 %
- Missing Value6 %
- CSV Reader6 %
Row Filter (deprecated)6 %Excel Reader (XLS)5 %- Excel Reader4 %
- Statistics3 %
- Math Formula3 %
- String to Number2 %
- Data Explorer2 %
Number To String2 %- Concatenate2 %
- Joiner2 %
- GroupBy1 %
- Rule-based Row Filter1 %
- Duplicate Row Filter1 %
Linear Correlation1 %- Number to String1 %
File Reader1 %- Group Loop Start1 %
String To Number1 %- Rule Engine1 %
- Missing Value Column Filter1 %
- Category to Number< 1 %
- Partitioning< 1 %
- Numeric Outliers< 1 %
Column Rename< 1 %- String to Date&Time< 1 %
- Nominal Value Row Filter< 1 %
- Sorter< 1 %
- Normalizer< 1 %
- Interactive Table (legacy)< 1 %
- Rank Correlation< 1 %
- Correlation Filter< 1 %
- Linear Correlation< 1 %
- Color Manager< 1 %
Excel Reader (XLS)< 1 %- String Manipulation< 1 %
- PCA Apply< 1 %
- Row Filter (Labs)< 1 %
- Denormalizer< 1 %
- Constant Value Column Filter< 1 %
- PCA< 1 %
- One to Many< 1 %
- File Reader (Complex Format)< 1 %
CSV Reader< 1 %Column Appender< 1 %- Double Input (legacy)< 1 %
- String Replacer< 1 %
- Table View (JavaScript)< 1 %
- Variable Expressions< 1 %
- Loop End< 1 %
- Table Creator< 1 %
Row Splitter (deprecated)< 1 %- Missing Value (Apply)< 1 %
- Value Counter< 1 %
- Rule-based Row Splitter< 1 %
- Box Plot (legacy)< 1 %
- Scatter Plot (JavaScript)< 1 %
Extract Date&Time Fields< 1 %- Column Aggregator< 1 %
- Math Formula (Multi Column)< 1 %
- File Reader< 1 %
- Reference Row Splitter< 1 %
- ARFF Reader< 1 %
Table Reader< 1 %- k-Means< 1 %
- Row Sampling< 1 %
- Column Expressions< 1 %
- Outlier Removal< 1 %
- Feature Selection Filter< 1 %
- Column List Loop Start< 1 %
- Numeric Scorer< 1 %
- IF Switch< 1 %
- DB Reader< 1 %
- Line Plot (JavaScript)< 1 %
- Decision Tree Predictor< 1 %
- SMOTE< 1 %
- RowID< 1 %
- One-way ANOVA< 1 %
- Chunk Loop Start< 1 %
- Equal Size Sampling< 1 %
- Pivot< 1 %
- String to Number (PMML)< 1 %
- Rank< 1 %
Rank Correlation< 1 %- Conditional Box Plot (legacy)< 1 %
- DB Query Reader< 1 %
- Table Row to Variable< 1 %
- Scorer< 1 %
- Category to Number (Apply)< 1 %
- Table Editor (JavaScript)< 1 %
- Independent groups t-test< 1 %
- Spark Statistics< 1 %
- Column Renamer< 1 %
Loop End< 1 %- X-Partitioner< 1 %
- Regression Predictor< 1 %
Numeric Scorer< 1 %- Auto-Binner< 1 %
- Numeric Binner< 1 %
- Column Resorter< 1 %
- Domain Calculator< 1 %
- Double to Integer< 1 %
- Nominal Value Row Splitter< 1 %
Joiner< 1 %- Low Variance Filter< 1 %
- Normalizer (PMML)< 1 %
Number To String (PMML)< 1 %- Date&Time Difference< 1 %
- RDKit Descriptor Calculation< 1 %
Table Row To Variable Loop Start< 1 %- Cluster Assigner< 1 %
- DBSCAN< 1 %
- Linear Regression Learner< 1 %
Scorer< 1 %- Cell Splitter< 1 %
- Column Auto Type Cast< 1 %
- Constant Value Column< 1 %
- Reference Row Filter< 1 %
- Number to String (PMML)< 1 %
- Number Rounder< 1 %
- Numeric Row Splitter< 1 %
- Column Splitter< 1 %
- Table Transposer< 1 %
- Numeric Outliers (Apply)< 1 %
- Crosstab< 1 %
- Double Configuration< 1 %
- Parameter Optimization Loop Start< 1 %
- Date&Time-based Row Filter< 1 %
- Table Reader< 1 %
- Table Row to Variable Loop Start< 1 %
- Polynomial Regression Learner< 1 %
Cell Replacer< 1 %- Table Manipulator< 1 %
- Normalizer (Apply)< 1 %
- String Manipulation (Multi Column)< 1 %
- Scatter Plot (Plotly)< 1 %
- Python Script (legacy)< 1 %
- Date&Time Part Extractor< 1 %
- Date Field Extractor (legacy)< 1 %
- Parquet Reader< 1 %
- Molecular Properties< 1 %
- RDKit Fingerprint< 1 %
Table Row to Variable< 1 %Python Script (1⇒1)< 1 %Read Excel Sheet Names (XLS)< 1 %- Column Filter (legacy)< 1 %
- Moving Aggregator< 1 %
- Cross Joiner< 1 %
- Reference Column Resorter< 1 %
- Rule Engine (Dictionary)< 1 %
- Normalize Plates (Z-Score)< 1 %
- Random Forest Predictor< 1 %
Database Connection Table Reader< 1 %PCA< 1 %- Logistic Regression Learner< 1 %
- Column Combiner< 1 %
- Number to Category (Apply)< 1 %
- Lag Column< 1 %
- Reference Column Filter< 1 %
- Date&Time to String< 1 %
- Combine Columns by Header< 1 %
- Table Column to Variable< 1 %
- Entropy Scorer< 1 %
- Gradient Boosted Trees Predictor< 1 %
- Similarity Search< 1 %
- Scorer (JavaScript)< 1 %
- Java Snippet< 1 %
String To Number (PMML)< 1 %- H2O MOJO Predictor (Regression)< 1 %
- Window Loop Start< 1 %
- MDS< 1 %
- Column Merger< 1 %
- Filter Apply< 1 %
String Replace (Dictionary)< 1 %- Standardized Cronbach Alpha< 1 %
- Single sample t-test< 1 %
- Stresser< 1 %
- Distance Matrix Calculate< 1 %
- Index Query< 1 %
- SAS7BDAT Reader< 1 %
- Column Filter Configuration< 1 %
- Value Filter (legacy)< 1 %
- String Input (legacy)< 1 %
- R Snippet< 1 %
- XLogP< 1 %
Recursive Loop Start< 1 %- Silhouette Coefficient< 1 %
- Cell Splitter By Position< 1 %
- Column Filter (PMML)< 1 %
- One to Many (PMML)< 1 %
- ROC Curve (legacy)< 1 %
- t-SNE (L. Jonsson)< 1 %
- Salesforce Simple Query< 1 %
Database Reader< 1 %PCA Apply< 1 %- Decision Tree to Ruleset< 1 %
CASE Switch Data (End)< 1 %- Extract Table Dimension< 1 %
- Data Generator< 1 %
- Python Source (legacy)< 1 %
- R Source (Table)< 1 %
- Window Slider< 1 %
- Trim Table< 1 %
- Fingerprints Expander< 1 %
- Exploration/Exploitation Score Combiner< 1 %
- Create Collection Column< 1 %
Table Column to Variable< 1 %Table Row to Variable< 1 %Line Reader< 1 %- Feature Selection Loop Start (1:1)< 1 %
- Loop End (Column Append)< 1 %
- PNN Learner (DDA)< 1 %
- Hierarchical Clustering< 1 %
- Simple Regression Tree Predictor< 1 %
Concatenate (Optional in)< 1 %- Bootstrap Sampling< 1 %
- Case Converter< 1 %
- Column Name Extractor< 1 %
- Column Rename (Regex)< 1 %
- Column to Grid< 1 %
- Edit Numeric Domain< 1 %
- Extract Missing Value Cause< 1 %
- Filter Apply Row Splitter< 1 %
- HiLite Row Splitter< 1 %
- Numeric Binner (PMML)< 1 %
- Denormalizer (PMML)< 1 %
- Unpivot< 1 %
- HiLite Table (legacy)< 1 %
- Lift Chart (legacy)< 1 %
- Shape Manager< 1 %
- Empty Table Creator< 1 %
- Mahalanobis Distance< 1 %
- k-Medoids< 1 %
- Math Formula (Variable)< 1 %
- Java Snippet (simple)< 1 %
- Bag Of Words Creator< 1 %
- Google Sheets Reader< 1 %
- Nominal Row Filter Configuration< 1 %
- Integer Input (legacy)< 1 %
- List Box Input (legacy)< 1 %
- ROC Curve (JavaScript)< 1 %
- Column Filter Widget< 1 %
- JSON Path< 1 %
- Duration to Number< 1 %
- Moving Average< 1 %
- String to Date/Time (legacy)< 1 %
- RDKit Molecule Substructure Filter< 1 %
- RDKit Salt Stripper< 1 %
- Range Filter< 1 %
- Variable Creator< 1 %
- X-Aggregator< 1 %
- PCA Inversion< 1 %
- PMML Gradient Boosted Trees Predictor (Regression)< 1 %
- Distance Matrix Pair Extractor< 1 %
- Table Validator< 1 %
- Table Validator (Reference)< 1 %
- Top k Row Filter< 1 %
- Paired t-test< 1 %
- DB Insert< 1 %
- H2O to Table< 1 %
- Java IF (Table)< 1 %
- String to Path< 1 %
- Integer Configuration< 1 %
- Integer Slider Configuration< 1 %
- Column Selection Configuration< 1 %
- Remove Empty Rows< 1 %
Views
- This node has no views
Workflows
!Modern UI_ABC-XYX-RFM AutoML SuperstoreKNIME Hub- 00. Install ExtensionsKNIME Hub
- 00. Install ExtensionsKNIME Hub
- 00. Install ExtensionsKNIME Hub
- 00. Install ExtensionsKNIME Hub
- Show all 974 workflows
Links
- Remove Outliersby mlauber71 on 2018-12-18forum.knime.com/p/51685
- Calculating averageby qqilihq on 2019-05-14forum.knime.com/p/60474
- Help with a Workflowby izaychik63 on 2018-12-18forum.knime.com/p/51709
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.