Icon

5x2cv demo

Workflow description: This workflow presents a component that calculates the 5x2cv Paired t-Test and demoes its use for a classification problem. Given values for two performance metrics, computed in 5 iterations of 2-fold cross-validation over the same dataset (randomly), the component performs a statistical test to determine whether the metric values are statistically equivalent or not. The 5x2cv Paired t-Test is an excellent alternative to compare different models with less bias.

Original paper: https://www.cmpe.boun.edu.tr/~ethem/files/papers/NC110804.PDF

Another reference used: https://sebastianraschka.com/pdf/lecture-notes/stat479fs18/11_eval-algo_notes.pdf

5x2cv Paired t-Test


Workflow description: This workflow presents a component that calculates the 5x2cv Paired t-Test and demoes its use for a classification problem. Given values for two performance metrics, computed in 5 iterations of 2-fold cross-validation over the same dataset (randomly), the component performs a statistical test to determine whether the metric values are statistically equivalent or not. The 5x2cv Paired t-Test is an excellent alternative to compare different models with less bias.


Original paper: https://www.cmpe.boun.edu.tr/~ethem/files/papers/NC110804.PDF

Another reference used: https://sebastianraschka.com/pdf/lecture-notes/stat479fs18/11_eval-algo_notes.pdf




You'll find the instructions to the exercises in the yellow annotations.

Read workflow thattrains and tests a DT model
Workflow Reader
Read workflow thattrains and tests anSVM model
Workflow Reader
Read data on vehicles(illustrative)
Table Reader
This component takes two classifiers and a dataset and outputs whether their performance is statistically equivalent or not, according tothe 5x2cv test
5x2cv Test

Nodes

Extensions

Links