SMO (3.7)

Implements John Platt's sequential minimal optimization algorithm for training a support vector classifier. This implementation globally replaces all missing values and transforms nominal attributes into binary ones

It also normalizes all attributes by default.(In that case the coefficients in the output are based on the normalized data, not the original data --- this is important for interpreting the classifier.)

Multi-class problems are solved using pairwise classification (1-vs-1 and if logistic models are built pairwise coupling according to Hastie and Tibshirani, 1998).

To obtain proper probability estimates, use the option that fits logistic regression models to the outputs of the support vector machine.

In the multi-class case the predicted probabilities are coupled using Hastie and Tibshirani's pairwise coupling method.

Note: for improved speed normalization should be turned off when operating on SparseInstances.

For more information on the SMO algorithm, see

J.Platt: Fast Training of Support Vector Machines using Sequential Minimal Optimization.

In B.Schoelkopf and C.

Burges and A.Smola, editors, Advances in Kernel Methods - Support Vector Learning, 1998.

S.S.

Keerthi, S.K.Shevade, C.

Bhattacharyya, K.R.K.Murthy (2001).

Improvements to Platt's SMO Algorithm for SVM Classifier Design.Neural Computation.

13(3):637-649.

Trevor Hastie, Robert Tibshirani: Classification by Pairwise Coupling.In: Advances in Neural Information Processing Systems, 1998.

(based on WEKA 3.7)

For further options, click the 'More' - button in the dialog.

All weka dialogs have a panel where you can specify classifier-specific parameters.

Options

SMO Options

D: If set, classifier is run in debug mode and may output additional info to the console

no-checks: Turns off all checks - use with caution! Turning them off assumes that data is purely numeric, doesn't contain any missing values, and has a nominal class. Turning them off also means that no header information will be stored if the machine is linear. Finally, it also assumes that no instance has a weight equal to 0. (default: checks on)

C: The complexity constant C. (default 1)

N: Whether to 0=normalize/1=standardize/2=neither. (default 0=normalize)

L: The tolerance parameter. (default 1.0e-3)

P: The epsilon for round-off error. (default 1.0e-12)

M: Fit logistic models to SVM outputs.

V: The number of folds for the internal cross-validation. (default -1, use training data)

W: The random number seed. (default 1)

K: The Kernel to use. (default: weka.classifiers.functions.supportVector.PolyKernel)

D: Enables debugging output (if available) to be printed. (default: off)

no-checks: Turns off all checks - use with caution! (default: checks on)

C: The size of the cache (a prime number), 0 for full cache and -1 to turn it off. (default: 250007)

E: The Exponent to use. (default: 1.0)

L: Use lower-order terms. (default: no)

Select target column
Choose the column that contains the target variable.
Preliminary Attribute Check

The Preliminary Attribute Check tests the underlying classifier against the DataTable specification at the inport of the node. Columns that are compatible with the classifier are marked with a green 'ok'. Columns which are potentially not compatible are assigned a red error message.

Important: If a column is marked as 'incompatible', it does not necessarily mean that the classifier cannot be executed! Sometimes, the error message 'Cannot handle String class' simply means that no nominal values are available (yet). This may change during execution of the predecessor nodes.

Capabilities: [Nominal attributes, Binary attributes, Unary attributes, Empty nominal attributes, Numeric attributes, Missing values, Nominal class, Binary class, Missing class values] Dependencies: [Nominal attributes, Binary attributes, Unary attributes, Empty nominal attributes, Numeric attributes, Date attributes, String attributes, Relational attributes] min # Instance: 1

Command line options

It shows the command line options according to the current classifier configuration and mainly serves to support the node's configuration via flow variables.

Additional Options

Select optional vector column
If the input table contains vector columns (e.g. double vector), the one to use can be selected here. This vector column will be used as attributes only and all other columns, except the target column, will be ignored.
Keep training instances
If checked, all training instances will be kept and stored with the classifier model. It is useful to calculate additional evaluation measures (see Weka Predictor) that make use of class prior probabilities. If no evaluation is performed or those measures are not required, it is advisable to NOT keep the training instances.

Input Ports

Icon
Training data

Output Ports

Icon
Trained model

Popular Predecessors

  • No recommendations found

Popular Successors

  • No recommendations found

Views

Weka Node View
Each Weka node provides a summary view that provides information about the classification. If the test data contains a class column, an evaluation is generated.

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.