Column Auto Type Cast

This node determines the most specific type in the configured string columns and changes the column types accordingly. The type order is to first check if the values are dates, then integer, long, double, and finally string. For dates a custom format can be specified.

Options

Manual Selection

Include
This list contains the names of those columns in the input table to be included in the output table.
Exclude
This list contains the names of those columns in the input table to be excluded from the output table.
Filter
Use one of these fields to filter either the Include or Exclude list for certain column names or name substrings.
Buttons
Use these buttons to move columns between the Include and Exclude list. Single-arrow buttons will move all selected columns. Double-arrow buttons will move all columns (filtering is taken into account).
Enforce Inclusion
Select this option to enforce the current inclusion list to stay the same even if the input table specification changes. If some of the included columns are not available anymore, a warning is displayed. (New columns will automatically be added to the exclusion list.)
Enforce Exclusion
Select this option to enforce the current exclusion list to stay the same even if the input table specification changes. If some of the excluded columns are not available anymore, a warning is displayed. (New columns will automatically be added to the inclusion list.)

Wildcard/Regex Selection

Type a search pattern which matches columns to move into the Include or Exclude list. Which list is used can be specified. You can use either Wildcards ('?' matching any character, '*' matching a sequence of any characters) or Regex. You can specify whether your pattern should be case sensitive.
Choose a date format
Choose or enter a date pattern. (y: Year, M: Month in year, d: Day in month, H: Hour in day, m: Minute in hour, s: Second in minute, S: Millisecond)
Missing value pattern
Choose or enter a missing value pattern. <none> is the default pattern and <empty> represents the empty string. The entered string pattern is applied to all included columns.
Quickscan
Check this checkbox if you want to speed up the node. The node will determine the most specific type based on the first 1000 rows. 1000 is the default for the "number of rows to consider" field.
Note: With quickscan enabled this node could fail during execute.

Input Ports

Icon
Arbitrary input data.

Output Ports

Icon
Input data with type-casted columns.
Icon
Information about the chosen type casting.

Views

This node has no views

Workflows

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.