Icon

05 Preprocessing II - exercise

There has been no title set for this workflow's metadata.

Text Mining Course: Preprocessing, Transformation, and Classification Models (exercise)

- Create Bag of Words.
- Filter terms that occur in less than 5 documents.

URL: Slides KNIME Analytics Platform Text Mining Course https://www.knime.com/form/material-download-registration

Create a bag of words and filter documents

  1. Create Bag of Words using the Bag Of Words Creator node.

  2. Filter out terms that occur in less than 5 documents.

    • Use the Term To String node to extract terms as strings from a bag of words.

    • Use the GroupBy node to group terms and count how many times they appear in pre-processed documents.

    • Filter terms that appear 5 or more times.

    • Use the Reference Row Filter node to filter bag of words and keep only terms that occur in at least 5 documents.



Session 3 - Preprocessing, Transformation, and Classification Models

Exercise 05 - Preprocessing II

Learning objective: In this exercise, you will extend the preprocessing steps from the previous exercise and create a bag of words.


Workflow description: This workflow further processes the texts by creating a bag of words and retaining only terms that occur in five or more documents.


You’ll find the instructions for the exercises in the yellow annotations.

Reading Textual Data
Preprocessing



Enrichment
Your Solution
Create documents
Strings To Document
No missings
Row Filter
Assign POS tags
POS Tagger
Stop Word Filter
Only documents
Column Filter
Snowball Stemmer
Case Converter
Punctuation Erasure
Tag Filter
Read Tripadvisor data
Table Reader
Number Filter

Nodes

Extensions

Links