Tika Language Detector

This node uses the Apache Tika library to detect the language of a given String/Document value. The newly detected languages will be appended to the input table. The list of all supported languages can be seen here . If the text contains mixed languages, the detector will, by default, return the language with the most confidence value.

Options

String or Document column

The column containing the strings or documents to parse.

New language column

The name of the appended column for the languages. Can be left empty.

Show Confidence value

Specify whether the confidence value of each detected language should be appended in a new column.

New confidence value column

The name of the appended column for the confidence value column. Can be left empty.

Show all detected languages

Specify whether all detected languages should be shown in the output table as a collection list. This is important for the case where the text might contain mixed languages.

Views

This node has no views

Workflows

• 03_Access_YouTube_REST_APIKNIME Hub
• 16_Tika_ParsingKNIME Hub
• 27_Semantic_Search_with_BERTKNIME Hub
• Basic Data Retrieval ExamplesKNIME Hub
• Brands_lyrics_analysisKNIME Hub
• Show all 23 workflows

Links

• Filter out values with non-latin charactersby stevelp on 2020-04-15

  forum.knime.com/p/87682

Developers