This node detects and treats the outliers for each of the selected columns individually by means of interquartile range (IQR).
To detect the outliers for a given column, the first and
third
quartile (Q1, Q3) is computed.
An observation is flagged an outlier if it lies
outside the range
R = [Q1 - k(IQR), Q3 + k(IQR)] with
IQR = Q3 - Q1 and k >= 0.
Setting k = 1.5 the smallest value in R corresponds,
typically, to the lower end of a boxplot's whisker and largest value
to its upper end.
Providing grouping information allows to detect outliers only
within their respective groups.
If an observation is flagged an outlier, one can either replace it by some other value or remove/retain the corresponding row.
Missing values contained in the data will be ignored, i.e., they will neither be used for the outlier computation nor will they be flagged as an outlier.
Options
Outlier Selection
General Settings
Outlier Treatment
Group Selection
Memory Policy
Output Ports
- Data table where outliers were either replaced or rows containing outliers/non-outliers were removed
- Data table holding the number of members, i.e., non-missing values and outliers as well as the lower and upper bound for each outlier groups
- Model holding the permitted interval bounds for each outlier group and the outlier treatment specifications
Popular Successors
- Missing Value8 %
- Normalizer5 %
- Partitioning3 %
- Statistics3 %
- Numeric Outliers (Apply)3 %
- GroupBy3 %
- Column Filter3 %
Linear Correlation2 %Row Filter (deprecated)2 %Excel Writer (XLS)2 %- Rule Engine2 %
- Math Formula2 %
- Box Plot2 %
- Linear Correlation1 %
- Joiner1 %
- Excel Writer1 %
Number To String1 %- Category to Number1 %
- CSV Writer< 1 %
- Color Manager< 1 %
- Linear Regression Learner< 1 %
- k-Means< 1 %
- Statistics View< 1 %
- Line Plot (JavaScript)< 1 %
- Numeric Outliers< 1 %
- Box Plot (JavaScript)< 1 %
- Loop End< 1 %
- Number to String< 1 %
- Radar Plot (Plotly)< 1 %
- Auto-Binner< 1 %
- Histogram< 1 %
- One to Many< 1 %
- Duplicate Row Filter< 1 %
- Polynomial Regression Learner< 1 %
- Concatenate< 1 %
- Domain Calculator< 1 %
- Density Plot< 1 %
Rank Correlation< 1 %Model Writer< 1 %- Box Plot (legacy)< 1 %
- Constant Value Column Filter< 1 %
- Rule-based Row Filter< 1 %
Loop End< 1 %- X-Partitioner< 1 %
- Value Counter< 1 %
- Table View (JavaScript)< 1 %
- Decision Tree Learner< 1 %
- Missing Value Column Filter< 1 %
- Cronbach Alpha< 1 %
- Data Explorer< 1 %
- Scatter Matrix (legacy)< 1 %
- Scatter Plot< 1 %
- Tile View (JavaScript)< 1 %
- Cluster Assigner< 1 %
- Column Renamer< 1 %
- Column Resorter< 1 %
- Rank Correlation< 1 %
- Pie chart (legacy)< 1 %
- Date&Time Part Extractor< 1 %
- Moving Aggregator< 1 %
- Model Writer< 1 %
- Crosstab< 1 %
- Table View< 1 %
- Numeric Distances< 1 %
- R View (Table)< 1 %
CSV Writer< 1 %- K Nearest Neighbor< 1 %
- Scorer< 1 %
- PCA Compute< 1 %
Concatenate (Optional in)< 1 %- Cell Splitter< 1 %
- Column Aggregator< 1 %
- Correlation Filter< 1 %
- Double to Integer< 1 %
- Nominal Value Row Splitter< 1 %
- RowID< 1 %
- 3D Scatter Plot (Plotly)< 1 %
- Line Plot (Plotly)< 1 %
- Pie/Donut Chart (JavaScript)< 1 %
- Table Editor (JavaScript)< 1 %
- Python View (legacy)< 1 %
- R Plot< 1 %
- Table Writer< 1 %
- Feature Selection Filter< 1 %
- Gradient Boosted Trees Learner (Regression)< 1 %
- Gradient Boosted Trees Predictor (Regression)< 1 %
- Random Forest Predictor (Regression)< 1 %
- Simple Regression Tree Predictor< 1 %
- String to Number< 1 %
- Extract Missing Value Cause< 1 %
- Reference Column Filter< 1 %
- Reference Row Splitter< 1 %
- Table Manipulator< 1 %
- String to Number (PMML)< 1 %
- Row Sampling< 1 %
- String Manipulation< 1 %
- One-way ANOVA< 1 %
- Bar Chart< 1 %
- Counter Generation< 1 %
- Histogram (JavaScript)< 1 %
- ROC Curve (JavaScript)< 1 %
- Python Script (legacy)< 1 %
- Date&Time-based Row Filter< 1 %
- Notched Boxplot (JFreechart)< 1 %
- 2D/3D Scatterplot< 1 %
- ARIMA Learner< 1 %
- Table Row to Variable< 1 %
- DBSCAN< 1 %
- Regression Predictor< 1 %
- Numeric Binner< 1 %
String To Number< 1 %- Constant Value Column< 1 %
- Equal Size Sampling< 1 %
- Nominal Value Row Filter< 1 %
- Row Filter (Labs)< 1 %
- Reference Row Filter< 1 %
- Normalizer (Apply)< 1 %
- Pivot< 1 %
Number To String (PMML)< 1 %- Numeric Row Splitter< 1 %
- String Manipulation (Multi Column)< 1 %
- Top k Row Filter< 1 %
- Interactive Histogram (legacy)< 1 %
- ROC Curve (legacy)< 1 %
- Pie Chart< 1 %
- Scatter Plot Matrix< 1 %
- Column Expressions< 1 %
- Table to H2O< 1 %
- Math Formula (Multi Column)< 1 %
- Radar Plot Appender< 1 %
- Scatter Plot (JavaScript)< 1 %
Python Script (1⇒1)< 1 %- RDKit Fingerprint< 1 %
- Outlier Removal< 1 %
Table Row to Variable< 1 %Table Writer< 1 %- Java Snippet< 1 %
- Feature Selection Loop Start (1:1)< 1 %
- Counting Loop Start< 1 %
- Naive Bayes Learner< 1 %
- PNN Learner (DDA)< 1 %
- Hierarchical Clustering< 1 %
- Decision Tree Predictor< 1 %
- Logistic Regression Learner< 1 %
- Entropy Scorer< 1 %
- Numeric Scorer< 1 %
- SMOTE< 1 %
- PCA Apply< 1 %
- PCA< 1 %
- Gradient Boosted Trees Predictor< 1 %
- Random Forest Learner< 1 %
- Random Forest Predictor< 1 %
- Simple Regression Tree Learner< 1 %
- Bootstrap Sampling< 1 %
Cell Replacer< 1 %- Column Appender< 1 %
- Lag Column< 1 %
- Cross Joiner< 1 %
- HiLite Row Splitter< 1 %
Row Splitter (deprecated)< 1 %- Row Splitter (Labs)< 1 %
Joiner< 1 %- Low Variance Filter< 1 %
- Denormalizer< 1 %
- Missing Value (Apply)< 1 %
- Normalizer (PMML)< 1 %
- Number to String (PMML)< 1 %
Column Rename< 1 %- Number Rounder< 1 %
- Sorter< 1 %
- Column Splitter< 1 %
- String Replacer< 1 %
- String Replacer (Dictionary)< 1 %
- Table Difference Finder< 1 %
- Table Transposer< 1 %
- Unpivot< 1 %
- Rule-based Row Splitter< 1 %
- Independent groups t-test< 1 %
- Extract Table Dimension< 1 %
- Conditional Box Plot (legacy)< 1 %
- Histogram (legacy)< 1 %
- Line Plot (legacy)< 1 %
- Parallel Coordinates (legacy)< 1 %
- Scatter Plot (legacy)< 1 %
Color Appender< 1 %- Interactive Table (legacy)< 1 %
- Distance Matrix Calculate< 1 %
- k-Medoids< 1 %
- Bar Chart (JavaScript)< 1 %
- Conditional Box Plot (JavaScript)< 1 %
- Scatter Plot (Plotly)< 1 %
- Violin Plot (Plotly)< 1 %
- Heatmap (JavaScript)< 1 %
- Lift Chart (JavaScript)< 1 %
- Data to Report (BIRT)< 1 %
- String to Date&Time< 1 %
Extract Date&Time Fields< 1 %- Moving Average< 1 %
- Loop End (Column Append)< 1 %
- Column List Loop Start< 1 %
PCA< 1 %Scorer< 1 %- Edit Numeric Domain< 1 %
- Mahalanobis Distance< 1 %
Numeric Scorer< 1 %- Association Rule Learner< 1 %
- Gradient Boosted Trees Learner< 1 %
- Random Forest Learner (Regression)< 1 %
- Extract Table Spec< 1 %
- Similarity Search< 1 %
- Model to Cell< 1 %
Excel Writer (XLS)< 1 %- Column Filter Configuration< 1 %
- Table to R< 1 %
- Image Writer (Table)< 1 %
- MultiLayerPerceptron Predictor< 1 %
- OPTICS Cluster Assigner< 1 %
PCA Compute< 1 %Gradient Boosted Trees Learner< 1 %- PMML Gradient Boosted Trees Predictor (Regression)< 1 %
- Tree Ensemble Learner< 1 %
- Auto-Binner (Apply)< 1 %
- Binner (Dictionary)< 1 %
- Edit Nominal Domain< 1 %
- Shuffle< 1 %
- Ungroup< 1 %
- Rule Engine (Dictionary)< 1 %
- Rule-based Row Filter (Dictionary)< 1 %
- Single sample t-test< 1 %
- Paired t-test< 1 %
- Linear Discriminant Analysis< 1 %
- Empty Table Switch< 1 %
- End IF< 1 %
- HiLite Table (legacy)< 1 %
- 2D Density Plot (Plotly)< 1 %
- PMML Predictor< 1 %
- Line Chart (JFreeChart)< 1 %
- Java Snippet (simple)< 1 %
- Column Filter (legacy)< 1 %
- Scorer (JavaScript)< 1 %
Python Script (1⇒2)< 1 %XGBoost Linear Ensemble Learner (Regression)< 1 %- Remove Empty Rows< 1 %
- RDKit Canon SMILES< 1 %
- Profit Engine< 1 %
- Dose Response (R)< 1 %
- Convert to R< 1 %
- MolExporter< 1 %
- ARIMA Predictor< 1 %
- ARIMA Visualization< 1 %
- Extract Variables (Data)< 1 %
Image Writer (Table Column)< 1 %- Table to Image< 1 %
Database Writer< 1 %- Feature Selection Loop Start (2:2)< 1 %
Loop End (2 ports)< 1 %Counting Loop Start< 1 %Interval Loop Start< 1 %- Chunk Loop Start< 1 %
- Group Loop Start< 1 %
Variable Loop End< 1 %- X-Aggregator< 1 %
- Naive Bayes Predictor< 1 %
- PNN Predictor< 1 %
- Fuzzy c-Means< 1 %
- Hierarchical Cluster Assigner (local)< 1 %
K Nearest Neighbor< 1 %- RProp MLP Learner< 1 %
- OPTICS Cluster Compute< 1 %
PCA Apply< 1 %- Logistic Regression Predictor< 1 %
- SVM Learner< 1 %
- SVM Predictor< 1 %
Gradient Boosted Trees Learner (Regression)< 1 %Gradient Boosted Trees Predictor< 1 %- Tree Ensemble Predictor< 1 %
- Add Empty Rows< 1 %
- Column Auto Type Cast< 1 %
- Column Combiner< 1 %
- Number to Category (Apply)< 1 %
Column Appender< 1 %- Column Name Extractor< 1 %
- Column Rename (Regex)< 1 %
- Table Validator (Reference)< 1 %
- CAIM Applier< 1 %
- CAIM Binner< 1 %
- Edit Nominal Domain (Dictionary)< 1 %
- Filter Apply< 1 %
Normalizer< 1 %- One to Many (PMML)< 1 %
String To Number (PMML)< 1 %- Nominal Probability Distribution Creator< 1 %
- Rank< 1 %
String Replace (Dictionary)< 1 %- Ruleset Predictor< 1 %
- Bland-Altman Plot< 1 %
- Shapiro-Wilk Test< 1 %
- Kolmogorov-Smirnov Test< 1 %
- Lift Chart (legacy)< 1 %
- Interactive Pie chart (legacy)< 1 %
- Shape Manager< 1 %
- Size Manager< 1 %
- Save Workflow< 1 %
- Molecule Type Cast< 1 %
- DB Update< 1 %
- DB Writer< 1 %
- Time Series Generator< 1 %
- String Distances< 1 %
- Stacked Area Chart (JavaScript)< 1 %
- Sunburst Chart (JavaScript)< 1 %
- DL4J Feedforward Learner (Regression) (legacy)< 1 %
- External Tool< 1 %
H2O MOJO Predictor (Classification)< 1 %- GroupBy Bar Chart (JFreeChart)< 1 %
- HeatMap (JFreeChart)< 1 %
- Histogram Chart (JFreeChart)< 1 %
- Scatter Plot (JFreeChart)< 1 %
Excel Sheet Appender (XLS)< 1 %Excel Sheet Appender (XLS)< 1 %- Send to Power BI< 1 %
- Java IF (Table)< 1 %
- Strings to Document< 1 %
- String to Term< 1 %
- Tag Cloud< 1 %
- Column Selection Configuration< 1 %
- Range Slider Filter Definition (legacy)< 1 %
- Value Filter (legacy)< 1 %
- Decision Tree View (JavaScript)< 1 %
- Generic JavaScript View (JavaScript)< 1 %
- Interactive Value Filter Widget< 1 %
- Column Selection Widget< 1 %
- Container Input (Row)< 1 %
- Quantile Filter< 1 %
- R Snippet< 1 %
- Date&Time Difference< 1 %
- Date&Time to String< 1 %
- Mask Date/Time (legacy)< 1 %
- Time to String (legacy)< 1 %
XGBoost Tree Ensemble Learner< 1 %XGBoost Tree Ensemble Learner (Regression)< 1 %- XGBoost Predictor< 1 %
- XGBoost Predictor (Regression)< 1 %
XML Writer< 1 %- RDKit From Molecule< 1 %
- Latitude/Longitude to Coordinate< 1 %
Views
- This node has no views
Workflows
!Modern UI_ABC-XYX-RFM AutoML SuperstoreKNIME Hub- 00. Install ExtensionsKNIME Hub
- 00. Install ExtensionsKNIME Hub
- 00. Install ExtensionsKNIME Hub
- 00. Install ExtensionsKNIME Hub
- Show all 973 workflows
Links
- Remove Outliersby mlauber71 on 2018-12-18forum.knime.com/p/51685
- Calculating averageby qqilihq on 2019-05-14forum.knime.com/p/60474
- Help with a Workflowby izaychik63 on 2018-12-18forum.knime.com/p/51709
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.