Icon

05_​Cohen's_​Kappa_​for_​Evaluating_​Classification_​Models

Cohen's Kappa for Evaluating Classification Models
Case 1: Model training without resampling Case 2: Model training with resampling Apply the model to test data with different distributions of thetarget class. Collect their Cohen's kappa values and plot them ina line plot. Train two models with unbalanced data. One with and the otherwithout resampling the training set. customer ratingTarget column: removeString: unknown70/30 onscorebad: 100good: 900Target column: removeString: unknowngoodbadVarying class proportionsPositive classprobability vs.Cohen's kappacol_meanCreate 100 test sets withthe same class distributionTarget column: removeString: unknowntest.tableDecTree.pmmlRead test.tableDecTree.pmmlCohen's kappaCollect proportion of badand Cohen's kappaRead GermanCredit.csv Rule Engine Missing Value(Apply) Missing Value Partitioning DecisionTree Learner Decision TreePredictor Nominal ValueRow Splitter Bootstrap Sampling Bootstrap Sampling Concatenate DecisionTree Learner Missing Value Decision TreePredictor Missing Value(Apply) SMOTE Scorer (JavaScript) Scorer (JavaScript) Concatenate Decision TreePredictor Bootstrap Sampling Bootstrap Sampling Nominal ValueRow Splitter Counting Loop Start Line Plot Loop End Math Formula Class proportions Line Color Math Formula Counting Loop Start Missing Value Table Writer PMML Writer Table Reader PMML Reader Scorer Variable toTable Row Table Rowto Variable Variable Loop End CSV Reader Case 1: Model training without resampling Case 2: Model training with resampling Apply the model to test data with different distributions of thetarget class. Collect their Cohen's kappa values and plot them ina line plot. Train two models with unbalanced data. One with and the otherwithout resampling the training set. customer ratingTarget column: removeString: unknown70/30 onscorebad: 100good: 900Target column: removeString: unknowngoodbadVarying class proportionsPositive classprobability vs.Cohen's kappacol_meanCreate 100 test sets withthe same class distributionTarget column: removeString: unknowntest.tableDecTree.pmmlRead test.tableDecTree.pmmlCohen's kappaCollect proportion of badand Cohen's kappaRead GermanCredit.csv Rule Engine Missing Value(Apply) Missing Value Partitioning DecisionTree Learner Decision TreePredictor Nominal ValueRow Splitter Bootstrap Sampling Bootstrap Sampling Concatenate DecisionTree Learner Missing Value Decision TreePredictor Missing Value(Apply) SMOTE Scorer (JavaScript) Scorer (JavaScript) Concatenate Decision TreePredictor Bootstrap Sampling Bootstrap Sampling Nominal ValueRow Splitter Counting Loop Start Line Plot Loop End Math Formula Class proportions Line Color Math Formula Counting Loop Start Missing Value Table Writer PMML Writer Table Reader PMML Reader Scorer Variable toTable Row Table Rowto Variable Variable Loop End CSV Reader

Nodes

Extensions