Icon

Cohens Kappa

This workflow demonstrates how Cohen's kappa can be used to evaluate the performance of a classification model when dealing with imbalanced data. We also show how Cohen's kappa obtains greater values not only due to better model performance, but also because of a more balanced target class distribution.

URL: Cohen's Kappa: Learn It, Use It, Judge It https://www.knime.com/blog/cohens-kappa-an-overview
URL: Scoring Metrics eBook https://www.knime.com/knimepress/scoring-metrics-evaluating-machine-learning-models

Case 1: Model training without resampling

Case 2: Model training with resampling

70/30 on score
Partitioning
Target column: remove String: unknown
Missing Value
Preprocessing
Decision Tree Learner
Read GermanCredit.csv
CSV Reader
Decision Tree Predictor
Decision Tree Predictor
Missing Value (Apply)
Decision Tree Learner
Missing Value (Apply)
Scorer (JavaScript)
SMOTE
Target column: remove String: unknown
Missing Value
Scorer (JavaScript)

Nodes

Extensions

Links