Text Classifier Predictor

Go to Product

This node uses the dictionary build with the corresponding learner node and predicts the categories for uncategorized documents by looking up the relevance scores in the dictionary and assigning the categories with the highest probability.

This classifier won the first Research Garden competition where the goal was to classify product descriptions into eight different categories. See press release (on archive.org).

The complementary Naïve Bayes scoring has been described in “Tackling the Poor Assumptions of Naive Bayes Text Classifiers”; Jason D. M. Rennie; Lawrence Shih; Jaime Teevan; David R. Karger; 2003. This way, not the term counts in the regarded class, but the counts from all other classes are regarded for each class prediction. This leads to better classification accuracy.

Options

Text input
The column containing the text which will be used for classification.
Append columns with class distribution
Activate to append a column for each class holding the probability value.

Advanced

Scoring formula
Allows to customize the scoring. Usually, the “Palladian” option provides a good tradeoff between speed and accuracy, while the complementary Naïve Bayes scorer may provide a better accuracy in some cases (lots of classes, usually).

Input Ports

Icon
The model data of the trained classifier.
Icon
Input with text documents to categorize.

Output Ports

Icon
Documents with assigned categories based on the supplied model.

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.