0 ×

Keras Alpha Dropout Layer

KNIME Deep Learning - Keras Integration version 4.0.0.v201906111427 by KNIME AG, Zurich, Switzerland

Applies Alpha Dropout to the input. Alpha Dropout is a Dropout that keeps mean and variance of inputs to their original values, in order to ensure the self-normalizing property even after this dropout. Alpha Dropout fits well to Scaled Exponential Linear Units by randomly setting activations to the negative saturation value. Corresponds to the Keras Alpha Dropout Layer.

Options

Name prefix
The name prefix of the layer. The prefix is complemented by an index suffix to obtain a unique layer name. If this option is unchecked, the name prefix is derived from the layer type.
Drop rate
The drop probability (as with Dropout). The multiplicative noise will have standard deviation sqrt(rate / (1 - rate)).
Noise shape
The shape of the binary dropout mask that will be multiplied with the input. The noise shape has to include the batch dimension which means in case of 2D images with shape [height, width, channels], the noise shape must must have rank 4 i.e. [batch, height, width, channels]. In order to reuse the dropout mask along specific dimensions set those to '1'. Spatial dropout where whole feature maps are dropped can be achieved by setting noise shape to 'batch_size, 1, 1, feature_dim_size'.
Random seed
Random seed to use for the dropping.

Input Ports

The Keras deep learning network to which to add an Alpha Dropout layer.

Output Ports

The Keras deep learning network with an added Alpha Dropout layer.

Installation

To use this node in KNIME, install KNIME Deep Learning - Keras Integration from the following update site:

KNIME 4.0
Wait a sec! You want to explore and install nodes even faster? We highly recommend our NodePit for KNIME extension for your KNIME Analytics Platform.