Spark Linear Regression Learner (MLlib)

Options

Regularizer

The purpose of the regularizer is to encourage simple models and avoid overfitting. For more details on supported regularizers see the Regularizers section of the MLlib documentation.

Regularization

The fixed regularization parameter r >= 0 defines the trade-off between the two goals of minimizing the loss (i.e., training error) and minimizing model complexity (i.e., to avoid overfitting).

Number of iterations

The number of iterations the method should run.

Loss function

For more details on the supported loss functions see the Loss function section of the MLlib documentation.

Step size

The initial step size of SGD for the first step. In subsequent steps, the step size will decrease with stepSize/sqrt(t). Only available for SGD.

Fraction

The fraction of data to be used for each SGD iteration. The default of 1.0 corresponds to deterministic/classical gradient descent. Only available for SGD.

Use feature scaling

Select this option to use feature scaling before model training to reduce the condition numbers which can significantly help the optimizer converging faster. Whether to perform feature scaling before model training to reduce the condition numbers which can significantly help the optimizer converging faster. The scaling correction will be translated back to resulting model weights, so it's transparent to users.

Add intercept

Select this option to add intercept.

Validate data

Select this option if the algorithm should validate data before training.

Class column

The classification column. Must be numeric.

Feature Columns

The feature columns to learn the model from. Supports only numeric columns.

Views

This node has no views

Workflows

• No workflows found

Links

• No links available

Developers