Table Structure Validator

This node ensures a certain table structure given by the reference structure specification defined in the dialog. The base for the configuration can also be given by the structure of the input table during configuration.

It is ensured that the result table structure is mostly identical to the defined specification. That is done by resorting of columns, the insertion of missing columns (filled with missing values) and optional removal of additional columns.

You can also choose for all columns if they are required to exist and if the column type can be converted.

If the validation succeeds, data is output to the first port (potentially renamed, sorted according to the defined specification and with converted types).

If the validation fails, the first port is inactive and the second port contains a table that lists all conflicts or the node fails.

Options

Reference structure
Define the reference structure to validate against by specifying the expected columns and their types.
  • Column name: The name of the reference column to validate against.
  • Column type: The type of the reference column to validate against.
Set input table as template
Sets the input table specification as reference structure template.
Column name matching
Controls what counts as a column name match between the input table and the reference table. If 'case insensitive' is chosen, it still tries to find an exactly (case sensitively) matching column name first, and then falls back to case insensitive matching.
  • Case sensitive: Column names must match exactly
  • Case insensitive: Also columns with a similar name will be considered to be validated according to this configuration.
If a column is not in the table
Ensures that the configured columns exist in the input table. If case insensitive name matching is selected, the first matching column will satisfy this condition.
  • Ignore: Ignore missing columns and do nothing
  • Fail validation: Fails the validation if columns don't exist
  • Insert column with missing values: Inserts missing columns and fills them with missing values
If there is an additional column in the table
Specifies how to handle columns which are not included in the reference table but present in the table to validate.
  • Fail validation: Additional columns will cause the validation to fail
  • Remove: Additional columns will be removed
  • Move to end: Additional columns will be moved to the end of the table
If data type does not match
Ensures correct data type for the columns.
  • Fail validation: Fails the validation if reference data type is not a super type of the data type to validate
  • Ignore: Ignores data type mismatches and do nothing
  • Try to convert: Attempts conversion and fails the validation if not possible
If validation fails
Controls how validation faults should influence the workflow execution.
  • Fail node: Forces the node to fail if the validation fails, with detailed validation fault descriptions. There data validation will be skipped if the structure validation already fails.
  • Deactivate first output port: Never fails but deactivates first output port if the validation fails and outputs results at the second port. It will always do both, structure and data validation.

Input Ports

Icon
Table to be validated.

Output Ports

Icon
Table with corrected and validated structure. Depending on the validation result and the If validation fails settings, this port may be inactive.
Icon
Table containing the column names that failed validation, an error ID, and an error description. Depending on the validation result and the If validation fails settings, this port may be inactive.

Popular Predecessors

  • No recommendations found

Popular Successors

  • No recommendations found

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.