This node assigns to each term of a document a part of speech (POS)
tag. It is applicable for French, English, German, Spanish and Arabic texts. The
underlying tagger models are models of the Stanford NLP group:
http://nlp.stanford.edu/software/tagger.shtml
For English texts the Penn Treebank tag set is used:
https://www.ling.upenn.edu/courses/Fall_2003/ling001/penn_treebank_pos.html.
For German texts the STTS tag set is used:
http://www.ims.uni-stuttgart.de/forschung/ressourcen/lexika/TagSets/stts-table.html.
For French texts the French Treebank tag set is used:
http://www.llf.cnrs.fr/Gens/Abeille/French-Treebank-fr.php.
For Spanish texts the Ancora Treebank tag set is used:
https://nlp.stanford.edu/software/spanish-faq.shtml#tagset.
For Arabic texts a Arabic Penn Treebank tag set is used:
https://nlp.stanford.edu/software/parser-arabic-faq.html#d.
There are also German, Spanish and French models using the Universal Dependencies POS tag set:
http://universaldependencies.org/u/pos/.
Note: the provided tagger models vary in memory consumption and processing speed. Especially the models English bidirectional, WSJ bidirectional, German hgc, and German dewac require a lot of memory. For the usage of these models it is recommended to run KNIME with at least 2GB of heap space. To increase the heap space, change the -Xmx setting in the knime.ini file. If KNIME is running with less than 1.5GB heap space it is recommended to use English left3words, English left3words caseless, or German fast models for tagging of english or german texts.
Descriptions of the models (taken from the website of the Stanford NLP group):
- English bidirectional: Trained on WSJ sections 0-18 using a bidirectional architecture and including word shape and distributional similarity features. Penn Treebank tagset.
- English left3words: Trained on WSJ sections 0-18 and extra parser training data using the left3words architecture and includes word shape and distributional similarity features. Penn Treebank tagset.
- English left3words caseless: Trained on WSJ sections 0-18 and extra parser training data using the left3words architecture and includes word shape and distributional similarity features. Penn Treebank tagset. Ignores case.
- English WSJ 0-18 bidirectional distsim: Trained on WSJ sections 0-18 using a bidirectional architecture and including word shape and distributional similarity features. Penn Treebank tagset.
- English WSJ 0-18 bidirectional distsim: Trained on WSJ sections 0-18 using a bidirectional architecture and including word shape and distributional similarity features. Penn Treebank tagset.
- English WSJ 0-18 bidirectional no distsim: Trained on WSJ sections 0-18 using a bidirectional architecture and including word shape. No distributional similarity features. Penn Treebank tagset.
- English WSJ 0-18 caseless left 3 words distsim: Trained on WSJ sections 0-18 left3words architecture and includes word shape and distributional similarity features. Penn Treebank tagset. Ignores case.
- English WSJ 0-18 left 3 words distsim: Trained on WSJ sections 0-18 using the left3words architecture and includes word shape and distributional similarity features. Penn Treebank tagset.
- English WSJ 0-18 left 3 words no distsim: Trained on WSJ sections 0-18 using the left3words architecture and includes word shape. Penn Treebank tagset.
To use following tagger models, the specific language pack has to be installed. (File -> Install KNIME Extensions...)
- German hgc: Trained on the first 80% of the Negra corpus, which uses the STTS tagset.
- German dewac: This model uses features from the distributional similarity clusters built from the deWac web corpus.
- German fast: Lacks distributional similarity features, but is several times faster than the other alternatives.
- German fast caseless: Lacks distributional similarity features, but is several times faster than the other alternatives. Ignores case.
- German UD: This is a model that produces Universal Dependencies POS tags.
- French: Trained on the French treebank.
- French UD: This is a model that produces Universal Dependencies POS tags.
- Spanish: Trained on the Spanish Ancora tagset.
- Spanish distsim: Trained on the French Spanish ancora tagset.
- Spanish UD: This is a model that produces Universal Dependencies POS tags.
- Arabic: This is a model that produces POS tags for Arabic language.
Options
General options
Tagger options
Popular Predecessors
- Word Parser5 %
- Concatenate4 %
Row Filter (deprecated)3 %- Sentence Extractor3 %
- Reference Row Filter3 %
Excel Reader (XLS)3 %- PDF Parser2 %
- Document Data Extractor2 %
Table Reader2 %- Case Converter2 %
- Punctuation Erasure2 %
- OpenNLP NE Tagger2 %
- Strings to Document2 %
- Number Filter2 %
- CSV Reader2 %
CSV Reader2 %Row Splitter (deprecated)2 %- Markup Tag Filter2 %
- Replacer2 %
- Document Grabber2 %
- Stanford Tagger2 %
- Duplicate Row Filter2 %
- Column Filter2 %
- N Chars Filter2 %
Stop Word Filter2 %- Stop Word Filter2 %
- Oscar Tagger2 %
- POS Tagger2 %
- Case Converter2 %
- Snowball Stemmer2 %
- Tag Filter2 %
- NGram Creator2 %
- RegEx Filter2 %
- Dictionary Filter1 %
- Chunk Loop Start1 %
Cell Replacer< 1 %- Dictionary Replacer< 1 %
- StanfordNLP NE Tagger< 1 %
- Porter Stemmer< 1 %
- Term Neighborhood Extractor< 1 %
- Group Loop Start< 1 %
List Files< 1 %- Partitioning< 1 %
- Stanford Lemmatizer< 1 %
- Dictionary Tagger< 1 %
- Bag Of Words Creator< 1 %
Python Script (1⇒1)< 1 %- Row Sampling< 1 %
Excel Reader (XLS)< 1 %- Java Snippet (simple)< 1 %
- Kuhlen Stemmer< 1 %
- Meta Info Inserter< 1 %
- Tagged Document Viewer< 1 %
- Cell Splitter< 1 %
- Excel Reader< 1 %
- Create Collection Column< 1 %
File Reader< 1 %- Table Creator< 1 %
- GroupBy< 1 %
- Flat File Document Parser< 1 %
- Tika Parser< 1 %
- StanfordNLP NE Scorer< 1 %
- Tags to String< 1 %
- XPath< 1 %
- Hierarchical Cluster Assigner (local)< 1 %
Number To String< 1 %- Column Resorter< 1 %
- RowID< 1 %
- String Manipulation< 1 %
- End IF< 1 %
Color Appender< 1 %- Topic Extractor (Parallel LDA)< 1 %
- Tika Language Detector< 1 %
- Diacritic Remover< 1 %
- Dictionary Replacer (File-based)< 1 %
- Tag Stripper< 1 %
- Dml Document Parser< 1 %
- Abner Tagger< 1 %
- Dictionary Tagger (Multi Column)< 1 %
- Wildcard Tagger< 1 %
- Document Vector< 1 %
- String to Term< 1 %
- Term to String< 1 %
- Column Filter (legacy)< 1 %
- Tag Cloud (JavaScript)< 1 %
JSON Reader< 1 %- String to Number< 1 %
Joiner< 1 %- Number to String (PMML)< 1 %
- Sorter< 1 %
- Rule-based Row Filter< 1 %
- Rule Engine< 1 %
- Chi-Square Keyword Extractor< 1 %
- StanfordNLP NE Learner< 1 %
Regex Extractor< 1 %
Views
- This node has no views
Workflows
01_Keyphrase_ExtractionKNIME Hub- 01_Keyphrase_ExtractionKNIME Hub
- 01_POS_NE_TaggersKNIME Hub
- 01_POS_NE_TaggersKNIME Hub
- 02_NetworkAnalytics_meets_TextProcessingKNIME Hub
- Show all 68 workflows
Links
- No links available
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.