TD_TextParser

fastpath function used to parse text

Options

Accumulate: Specifies the input table columns to copy to the output table. By default, the function copies no input table columns to the output table.
ConvertToLowerCase: Specifies whether to convert input text to lowercase.
Delimiter: Specifies an expression that represents the word delimiter.
Punctuation: Specifies an expression that represents the punctuation characters to replace with a space in the input text.
RemoveStopWords: Specifies whether to remove stop words from the input text before parsing.
StemTokens: Specify whether to stem the tokens.
Output Schema: Output Schema, if Volatile is true then use user login as the schema.
Output Table: Output Table
VAL Location: VAL Location
Volatile: Specifies whether the table should be a VOLATILE table. If true, then the table is automatically deleted, otherwise it is users responsibility to remove or clean it up for space.
TextColumn: Specifies the name of the input column whose contents are to be tokenized.
TokenColName: Specifies the name of the output column that contains the individual tokens from the input document.