This node produces a complex view made of four different charts in order to compare, optimize and select predictions of different binary classifiers:
- Compare a number of binary classifier machine learning models predicting the same target on the same test data using performance metrics and ROC curves
- Optimize a model by finding the best threshold given a performance metric of your choice
- Interactively select a given type of predictions (e.g. true positives) of one of the models and export them at the output of the node
The user journey when using this view follows these steps:
- Compare model AUC to select the best model via the Model's Statistics bar chart and the Model's ROC Curves chart in the top panel;
- Change the threshold from it's initial value either manually, via the Threshold Slider , or automatically maximizing one of the available function (e.g. F-Measure) via the Model Tab Dropdown.
- Look back at the top panel to see how the new threshold impacts the model when compared with the other models.
- Inspect the Confusion Matrix in the bottom panel to assess the gravity of the misclassification, give the associated probability confidence of the model on the Classification Distribution chart.
- Combine this view with other KNIME views in a Component to interactively visualize different types of visualizations (e.g. false positives) with interactive selection events.
- After interaction use the "Apply" features to export the new threshold and selected model from the node as flow variables. This will also export: A) selected model predictions B) selection of the confusion matrix cell C) selected model performance statistics.
The node supports custom CSS styling. You can simply put CSS rules into a single string and set it as a flow variable 'customCSS' in the node configuration dialog. You will find the list of available classes and their description on our documentation page.
Options
Main
Execution critical options affecting the success and output of the node.
Style
The options in this tab will modify general view settings.
Model Stats Chart
This tab holds options for the Bar chart in the view.
ROC Curve
This tab holds options for the ROC in the view.
Confusion Matrix
This tab contains options for the Confusion Matrix in the view.
Prediction Distributions
This tab holds options for the Dist plot in the view.
Interactivity/Controls
Settings for view interactivity and controls.
Input Ports
- Data table with a column for the ground truth (binary/nominal/class/0-1/etc.) and a column for each model containing the positive prediction probability of that model.
- A table with one COLORED row for each model column (NOT ground truth) with a single column containing the name of the column.
Output Ports
- The data table at this out-port is derived from the data input at
in-port #0 and can have a number of options. It will always
contain:
- The ground truth column selected in the dialog.
- The chosen model-prediction columns chosen in the dialog.
- A boolean "selected" column with a value of "true" or "false" depending on whether or not the row was selected in the confusion matrix in the view. The value will be "missing" if no selections were made or the view was not opened.
Optionally, the data table may also contain:
- A String-value column for EACH of the model-prediction columns chosen in the dialog. Each column will contain the label (either positive class or negative class) depending on the threshold for that model. The thresholds will either be taken from the dialog "Threshold Method" option OR be taken from the most recent value saved from the view for that model. To see which threshold was used to label each column, reference the row of statistics relating to each model in the 2nd out-port. To enable this option select the "Append new predictions for all models" option in the dialog.
-
A single String-value column for the selected model in the view.
This column will contain the label (either
positive class or
negative class) depending on the threshold for
the selected model in
the view. This column will contain "missing values" if no model was
selected in the view.
The name of this column can also be set in the
dialog to assist in downstream workflow processes.
The selected model column name and threshold will also be output as flow variables from this node.
To enable this option select the "Append prediction column for the selected model" option in the dialog.
The final option for this table is to exclude tables that are not the ground truth column or the selected model-prediction column(s). This will filter out any unwanted columns which may have been left over from upstream predictors. This option is NOT enabled by default. In order to take advantage of this option DESELECT the "Retain non-prediction columns in output table" option in the dialog. - Table containing a single row of statistics for each of the models chosen. This tables also contains a column corresponding to the threshold value used in the calculation of the statistics in this table and the (potential) labeling of the output data.
Popular Predecessors
- Decision Tree Predictor26 %
- Logistic Regression Predictor23 %
Joiner4 %- Joiner4 %
- Random Forest Predictor3 %
- Gradient Boosted Trees Predictor2 %
- Decision Tree View (JavaScript)2 %
- Scorer2 %
- H2O to Table2 %
- Column Appender2 %
- Column Filter1 %
- XGBoost Predictor1 %
- Concatenate< 1 %
- Binary Classification Inspector< 1 %
- Naive Bayes Predictor< 1 %
- GroupBy< 1 %
- MultiLayerPerceptron Predictor< 1 %
Column Rename< 1 %Scorer< 1 %- Rule-based Row Filter< 1 %
- Partitioning< 1 %
- String Manipulation< 1 %
- ROC Curve (JavaScript)< 1 %
- Regression Predictor< 1 %
- X-Aggregator< 1 %
- String to Number< 1 %
- Domain Calculator< 1 %
- Row Filter< 1 %
- Normalizer< 1 %
- Math Formula< 1 %
- Scorer (JavaScript)< 1 %
Loop End< 1 %- Number to String< 1 %
- Rule Engine< 1 %
- Workflow Executor< 1 %
- Capture Workflow End< 1 %
- Tree Ensemble Predictor< 1 %
- Random Forest Learner< 1 %
- Weka Predictor (3.7)< 1 %
- Logistic Regression Learner< 1 %
- Denormalizer< 1 %
- Pivot< 1 %
- Nominal Value Row Filter< 1 %
- Color Manager< 1 %
- Parameter Optimization Loop End< 1 %
- ROC Curve (legacy)< 1 %
- Column Expressions< 1 %
- Tika Parser< 1 %
- Parameter Optimization Loop Start< 1 %
CSV Reader< 1 %- Table Creator< 1 %
- Loop End (Column Append)< 1 %
- SVM Predictor< 1 %
- Math Formula (Multi Column)< 1 %
- Table Reader< 1 %
- Loop End< 1 %
- Number to String (PMML)< 1 %
- Sorter< 1 %
- Rule-based Row Splitter< 1 %
- Excel Reader< 1 %
- Python Script (legacy)< 1 %
- BERT Predictor< 1 %
- PMML Gradient Boosted Trees Predictor< 1 %
Column Appender< 1 %- PMML Predictor< 1 %
- Disturber Node< 1 %
- Strings to Binary Objects< 1 %
- Simple Regression Tree Predictor< 1 %
Table Reader< 1 %- Fuzzy Rule Predictor< 1 %
- K Nearest Neighbor< 1 %
- Numeric Scorer< 1 %
- Column Resorter< 1 %
- Extract Table Spec< 1 %
- Data Generator< 1 %
Color Appender< 1 %- Keras Network Executor< 1 %
- TensorFlow 2 Network Executor< 1 %
- Prediction Fusion< 1 %
- H2O MOJO Predictor (Classification)< 1 %
- H2O Statistics< 1 %
- H2O Random Forest Learner< 1 %
- Line Plot (JavaScript)< 1 %
- SHAP Loop Start< 1 %
- Python Predictor (legacy)< 1 %
- Binary Scorer< 1 %
- Table Column to Variable< 1 %
File Reader< 1 %- Group Loop Start< 1 %
- SOTA Predictor< 1 %
- Numeric Binner< 1 %
- Column Auto Type Cast< 1 %
- Number to Category (Apply)< 1 %
- Nominal Probability Distribution Creator< 1 %
- Ruleset Predictor< 1 %
- Statistics< 1 %
- Spark to Table< 1 %
- CSS Editor< 1 %
- R to Table< 1 %
- RDKit Fingerprint< 1 %
- BERT Classification Learner< 1 %
Views
- Interactive View: Binary Classification Inspector
- Binary Classification Inspector
Workflows
00_Install_ExtensionsKNIME Hub- 01 Advanced Machine Learning - ExerciseKNIME Hub
- 01 Advanced Machine Learning - solutionKNIME Hub
- 01_AutoML_Component_via_Interactive_ViewsKNIME Hub
- 01_BERT_Sentiment_AnalysisKNIME Hub
- Show all 285 workflows
Links
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.