Session 2 - Enrichment and Preprocessing

Solution 04 - Preprocessing

Learning objective: In this exercise, you will practice preprocessing text data.

Workflow description: This workflow performs a series of preprocessing operations to clean, filter and normalize texts.

You’ll find the instructions for the exercises in the yellow annotations.

Preprocess texts by cleaning it

1. Filter numbers, punctuation marks, stop words with the Number Filter, Punctuation Erasure and Stop Word Filter node, respectively.

2. Convert texts to lower case using the Case Converter node.

3. Perform stemming with the Snowball Stemmer node.

4. Keep only tokens tagged as nouns, verbs, and adjectives using the Tag Filter node.

   ---

Enrichment

Your Solution

Reading Textual Data