BERT Classification Learner

Trains a text classification model on top of the provided BERT model. The model is extended with 3 layers:
  • GlobalAveragePooling1D layer
  • Dropout layer
  • Dense layer

Besides the typical classification task where every row is assigned a single class it is also possible to train a model for multi-label classification where a row can be assigned multiple labels.

If a validation table is provided, then the model performance is evaluated on that data after every epoch.

Options

Settings

Sentence column
A column with plain text (String) or Documents, that contains text to be classified. No special pre-processing is needed.
Class column
A column that contains class labels.
Max sequence length
The maximum length of a sequence after tokenization. The upper limit is 512.
Multi-label classification
Enables multi-label classification mode. In this mode multiple labels (classes) can be assigned to each text.
Class separator
The character used to separate different classes assigned to a given text in multi-label classification mode.

Advanced

Number of epochs
The number of epochs used for training the classifier.
Batch size
The size of a chunk of the input data used for model update.
Validation batch size
The size of a chunk of the validation data to process.
Fine tune BERT
If checked then the weights of the BERT model will be trained along with the additional classifier. Fine-tuning BERT will be more resource and time intensive, but the results are usually better.
Optimizer
Available optimizers and their configuration.

Python

Python
Select one of the Python execution environment options:
  • use default Python environment for the Redfield BERT Nodes (can be configured on the preference page)
  • use Conda environment from a Conda flow variable (only selectable if such a flow variable is available)

Input Ports

Icon
BERT Model
Icon
Data Table
Icon
Optional Validation Table

Output Ports

Icon
BERT Classifier model
Icon
Statistics of the training process

Popular Predecessors

Popular Successors

Views

This node has no views

Workflows

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension Redfield BERT Nodes from the below update site following our NodePit Product and Node Installation Guide:

v5.2

A zipped version of the software site can be downloaded here.

Plugin provider: Redfield AB
Plugin version: 1.0.3.202402210241
On NodePit since: 2023-12-06
Last update: 2024-04-25
KNIME versions: v5.2, v5.1, v4.7, v4.6, v4.5, v4.4, v4.3, v4.2

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!