Icon

Just KNIME It S02 _​ CH06 _​ Airline Reviews

You work for a Marketing agency that monitors the online presence of a few airline companies to understand how they are being reviewed. You were asked to identify whether a tweet mentioning an airline is positive, neutral, or negative, and decided to implement a simple sentiment analysis classifier for this task.

What accuracy can you get when automating this process? Is the classifier likely to help company reviewers save their time?

Note: Given the size of the dataset, training the classifier may take a little while to execute on your machine (especially if you use more sophisticated methods). Feel free to use only a part of the dataset in this challenge if you want to speed up your solution.

Hint 1: Check our Textprocessing extension to learn more about how you can turn tweets' words into features that a classifier can explore.

Hint 2: Study, use, and/or adapt shared components Enrichment and Preprocessing and Document Vectorization (in this order!) if you want to get a part of the work done more quickly. They were created especially for this challenge.

Hint 3: Remember to partition the dataset into training and test set in order to create the decision tree model and then evaluate it. Feel free to use the partitioning strategy you prefer.

Author: @alinebessa

Just KNIME It - Season2 - Challenge06: Airline Reviews @VirginAmerica Tweets.table Airline Reviews Dataset in the KNIME Hub https://hub.knime.com/-/spaces/-/latest/~uUBjFImGzeJdG1ob/exclude < 100% $airline_sentiment_confidence$ Upper: $airline_sentiment_confidence$ = 1 [ 71.35 %, 10 445 samples ] Lower: $airline_sentiment_confidence$ <= 1 [ 28.65 %, 4 195 samples ] base KNIME nodes bag of words preprocessed from $text$ columndecision tree model scoreroverall accuracy == 76.99%color by airline_sentimentlabelexclude column $airline_sentiment_confidence$ train decision tree model for classificationapply existing decision tree modeltrain XGBoost model for classificationapply existing XGBoost modelupper: training 70%lower: test 30%xgbboost model scorer overall accuracy == 86.34% Table Reader Rule-basedRow Splitter Challenge DataPreprocessing Scorer (JavaScript) Color Manager Column Filter DecisionTree Learner Decision TreePredictor XGBoost TreeEnsemble Learner XGBoost Predictor Partitioning Scorer (JavaScript) Just KNIME It - Season2 - Challenge06: Airline Reviews @VirginAmerica Tweets.table Airline Reviews Dataset in the KNIME Hub https://hub.knime.com/-/spaces/-/latest/~uUBjFImGzeJdG1ob/exclude < 100% $airline_sentiment_confidence$ Upper: $airline_sentiment_confidence$ = 1 [ 71.35 %, 10 445 samples ] Lower: $airline_sentiment_confidence$ <= 1 [ 28.65 %, 4 195 samples ] base KNIME nodes bag of words preprocessed from $text$ columndecision tree model scoreroverall accuracy == 76.99%color by airline_sentimentlabelexclude column $airline_sentiment_confidence$ train decision tree model for classificationapply existing decision tree modeltrain XGBoost model for classificationapply existing XGBoost modelupper: training 70%lower: test 30%xgbboost model scorer overall accuracy == 86.34% Table Reader Rule-basedRow Splitter Challenge DataPreprocessing Scorer (JavaScript) Color Manager Column Filter DecisionTree Learner Decision TreePredictor XGBoost TreeEnsemble Learner XGBoost Predictor Partitioning Scorer (JavaScript)

Nodes

Extensions

Links