Spark Gradient-Boosted Trees Learner

This node applies the Apache Spark Gradient-Boosted Trees (GBTs) algorithm.

Note: GBTs do not yet support multiclass classification. The class column needs to contain 0 and 1 as class labels. For multiclass problems, please use decision trees or Random Forests.

Please note that all data must be numeric, including the label column which needs to contain 0 and 1. Use the Spark Category To Number nodes to convert nominal values to numeric columns. The mapping dictionary of the converter node is the input of the second in port of this node.

Use the Spark Predictor node to apply the learned model to unseen data.

Options

Number of iterations
Number of iterations of boosting. In other words, the number of weak hypotheses used in the final model.
Max number of bins
Maximum number of bins used for splitting features (suggested value: 100).
Max depth
Maximum depth of the tree. E.g., depth 0 means 1 leaf node; depth 1 means 1 internal node + 2 leaf nodes. (suggested value: 4)
Loss function
Loss function used for minimization during gradient boosting. Available functions: Log Loss, Squared Error and Absolute Error. For details about the loss functions see the Losses documentation.
Is classification
Select this option for binary classification.
Learning rate
Learning rate for shrinking the contribution of each estimator. The learning rate should be between in the interval (0, 1]
Class column
The classification column. Must be numeric.
Feature Columns
The feature columns to learn the model from. Supports only numeric columns.

Input Ports

Icon
Input Spark DataFrame/RDD
Icon
PMML with the nominal values mapping dictionary

Output Ports

Icon
Spark MLlib Gradient-Boosted Trees Model

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.