Conformal Scorer

Compares predictions made by Conformal Classifier with actual values. There are two types of scoring:

  • Efficiency – the ratio of single label classification (right or wrong). Calculated as Single class predictions / Total
    See Additional prediction information option section for parameters description.
  • Validity - counts the fraction of correct predictions. If a record belongs to a mixed class containing the correct value it is considered to be correct. Calculated as Total_match/Total
    See Additional prediction information option section for parameters description.

Options

Target column
A column that contains the real classes of the data.
Classes
A column that contains predictions produced by Conformal Classifier. Could be both collection or string column type.
Additional prediction information
Includes additional columns with some prediction metrics to the output table.
  • Exact match – number of correct predictions that belong to one class, and not belong to any mixed class.
  • Soft match - number of correct predictions that belong to one of the mixed classes.
  • Total match – Exact_match + Soft_match.
  • Error – number of predictions that do not include the target class.
  • Total – total number of records that belongs to the current target class.
  • Single class predictions - number of predictions resulted in a single class
  • Null predictions - number of null predictions

Input Ports

Icon
Table with ranked predictions and classes.

Output Ports

Icon
The accuracy statistics table.

Views

This node has no views

Workflows

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.