Icon

09 Decision Tree Model

09 Decision Tree and Classification Model Evaluation
Exercise: Decision Tree and Classification Model Evaluation1) Read the adult_joined.table file by executing the Table Reader node2) Partition the dataset into a training set (75%) and a test set (25%). Apply stratified sampling to the income column.3) Train a Decision Tree model on the training set to predict whether or not a person earns more than 50K per year4) Apply the model to the test set5) Evaluate the accuracy of the model with scoring metrics- What is the overall accuracy of the model? About 86%6) Open the configuration dialog of the Scorer (JavaScript) node and exclude those statistics from the class predictionstatistics table that are also present in the confusion matrix. Display the number of rows in the confusion matrix. - What is the number of rows in the test dataset? 8138 rows7) Evaluate the performance of the model with an ROC curve- What is the Area under the Curve statistics for the decision tree model? 0.888) OPTIONAL: Try out other parameter settings to reach a better performance. For example, change the quality measure,pruning method, or minimum number of records. Read adult_joined.tableNode 14Node 15Node 17 DecisionTree Learner ROC Curve Table Reader Scorer (JavaScript) Partitioning Decision TreePredictor Exercise: Decision Tree and Classification Model Evaluation1) Read the adult_joined.table file by executing the Table Reader node2) Partition the dataset into a training set (75%) and a test set (25%). Apply stratified sampling to the income column.3) Train a Decision Tree model on the training set to predict whether or not a person earns more than 50K per year4) Apply the model to the test set5) Evaluate the accuracy of the model with scoring metrics- What is the overall accuracy of the model? About 86%6) Open the configuration dialog of the Scorer (JavaScript) node and exclude those statistics from the class predictionstatistics table that are also present in the confusion matrix. Display the number of rows in the confusion matrix. - What is the number of rows in the test dataset? 8138 rows7) Evaluate the performance of the model with an ROC curve- What is the Area under the Curve statistics for the decision tree model? 0.888) OPTIONAL: Try out other parameter settings to reach a better performance. For example, change the quality measure,pruning method, or minimum number of records. Read adult_joined.tableNode 14Node 15Node 17 DecisionTree Learner ROC Curve Table Reader Scorer (JavaScript) Partitioning Decision TreePredictor

Nodes

Extensions

Links