Simple parallel threaded implementation of
LDA,
following Newman, Asuncion, Smyth and Welling,
Distributed Algorithms for Topic Models JMLR (2009), with SparseLDA sampling scheme and data structure
from Yao, Mimno and McCallum,
Efficient Methods for Topic Model Inference on Streaming Document Collections, KDD (2009).
The node uses the "MALLET: A Machine Learning for Language Toolkit." topic modeling library. Note: The current version of MALLET contains a known multi-threading bug that can cause the node to fail with an ArrayIndexOutOfBoundsException. Should you encounter this issue, setting the number of threads to one should solve the problem.
Options
Popular Successors
Excel Writer (XLS)10 %- GroupBy5 %
Row Filter (deprecated)2 %- Joiner2 %
Column Appender2 %- Color Manager2 %
- Column Aggregator2 %
- Topic Extractor (Parallel LDA)2 %
- Chi-Square Keyword Extractor2 %
- N Chars Filter1 %
Column Rename1 %- Object Inserter1 %
- Send to Power BI1 %
- TF1 %
- Text Classifier Learner1 %
- Group Loop Start< 1 %
- Constant Value Column< 1 %
Joiner< 1 %Table Writer< 1 %- Hierarchical Clustering< 1 %
- Table Manipulator< 1 %
Color Appender< 1 %- Pie Chart (JFreeChart)< 1 %
Document Data Extractor< 1 %- Heatmap (JavaScript)< 1 %
- Java Snippet< 1 %
- Rank< 1 %
- Statistics< 1 %
- Scatter Matrix (legacy)< 1 %
- Interactive Table (legacy)< 1 %
Excel Writer (XLS)< 1 %- Excel Writer< 1 %
- Term Co-Occurrence Counter< 1 %
- Document Data Extractor< 1 %
- Tag Cloud< 1 %
- CSV Writer< 1 %
- Loop End< 1 %
Loop End< 1 %- Decision Tree Learner< 1 %
- Linear Regression Learner< 1 %
- Scorer< 1 %
- Column Filter< 1 %
- Reference Row Filter< 1 %
- Sorter< 1 %
- Value Counter< 1 %
- Statistics View< 1 %
- DB Writer< 1 %
- 3D Scatter Plot (Plotly)< 1 %
- Math Formula< 1 %
XLS Writer< 1 %- DF< 1 %
- Category to Class< 1 %
- Case Converter< 1 %
- Stop Word Filter< 1 %
- Dictionary Tagger< 1 %
- Bag Of Words Creator< 1 %
- String to Term< 1 %
- Document Viewer< 1 %
- t-SNE (L. Jonsson)< 1 %
- Table View (JavaScript)< 1 %
- Tag Cloud (JavaScript)< 1 %
- Hierarchy Extractor< 1 %
- Data to Report (BIRT)< 1 %
- Catch Errors (Data Ports)< 1 %
Scorer< 1 %Cell Replacer< 1 %- Linear Correlation< 1 %
- Partitioning< 1 %
- Crosstab< 1 %
- Interactive Pie chart (legacy)< 1 %
Excel Sheet Appender (XLS)< 1 %- Porter Stemmer< 1 %
- Threshold Analyzer< 1 %
Loop End (3 ports)< 1 %- Entropy Scorer< 1 %
- Column Appender< 1 %
Row Splitter (deprecated)< 1 %- Table Transposer< 1 %
- Rule Engine< 1 %
- Line Plot (legacy)< 1 %
K Nearest Neighbor (Distance Function)< 1 %- Bar Chart (JavaScript)< 1 %
- Tableau Writer< 1 %
- StanfordNLP Relation Extractor< 1 %
- Keygraph Keyword Extractor< 1 %
- NGram Creator< 1 %
- Dictionary Filter< 1 %
- Number Filter< 1 %
- Punctuation Erasure< 1 %
Stop Word Filter< 1 %- Tag Filter< 1 %
Abner tagger< 1 %Document vector< 1 %- Term Vector< 1 %
- Table Writer< 1 %
Loop End (2 ports)< 1 %- PNN Predictor< 1 %
- k-Means< 1 %
- Decision Tree Predictor< 1 %
- Concatenate< 1 %
- Cross Joiner< 1 %
- Domain Calculator< 1 %
- Set Operator< 1 %
- Shuffle< 1 %
- Unpivot< 1 %
- Rule-based Row Filter< 1 %
- Rule-based Row Filter (Dictionary)< 1 %
Rank Correlation< 1 %- Histogram (legacy)< 1 %
- Parallel Coordinates (legacy)< 1 %
- Scatter Plot (JFreeChart)< 1 %
- StanfordNLP Open Information Extractor< 1 %
- String Matcher< 1 %
- Snowball Stemmer< 1 %
- Stanford Lemmatizer< 1 %
- StanfordNLP NE Tagger< 1 %
- Meta Info Extractor< 1 %
- Sentence Extractor< 1 %
Strings To Document< 1 %- Scatter Plot (JavaScript)< 1 %
- Container Output (Table)< 1 %
- R Snippet< 1 %
- Create Collection Column< 1 %
Table Row to Variable< 1 %CSV Writer< 1 %Naive Bayes Predictor< 1 %- Fuzzy Rule Learner< 1 %
- Fuzzy c-Means< 1 %
- DBSCAN< 1 %
- Decision Tree to Image< 1 %
- MultiLayerPerceptron Predictor< 1 %
PCA Apply< 1 %- PCA< 1 %
Random Forest Learner< 1 %- Random Forest Learner< 1 %
Concatenate (Optional in)< 1 %- Auto-Binner< 1 %
- Category to Number< 1 %
- Number to String< 1 %
- Column Merger< 1 %
- Column Resorter< 1 %
- Column to Grid< 1 %
- Many to One< 1 %
- Nominal Value Row Filter< 1 %
- Reference Row Splitter< 1 %
- Normalizer< 1 %
- Pivot< 1 %
- Normalizer (PMML)< 1 %
- String Manipulation< 1 %
- String Replacer< 1 %
String Replace (Dictionary)< 1 %- Top k Row Filter< 1 %
- Ungroup< 1 %
- Cache< 1 %
- Conditional Box Plot (legacy)< 1 %
- HiLite Table (legacy)< 1 %
- Interactive Histogram (legacy)< 1 %
- Pie chart (legacy)< 1 %
- Box Plot (legacy)< 1 %
- Scatter Plot (legacy)< 1 %
- Molecule Type Cast< 1 %
- Distance Matrix Calculate< 1 %
- Similarity Search< 1 %
- Pie/Donut Chart (JavaScript)< 1 %
- Scatter Plot (Plotly)< 1 %
- NG Visual Clusterer (beta)< 1 %
Table to HTML< 1 %Table to PDF< 1 %- External Tool< 1 %
- Math Formula (Multi Column)< 1 %
- Bar Chart (JFreeChart)< 1 %
- LIBSVMLearner< 1 %
Send to Tableau Server (Hyper)< 1 %- Word Vector Apply (legacy)< 1 %
Word Vector Learner (legacy)< 1 %- Doc2Vec Learner (legacy)< 1 %
- Frequency Filter< 1 %
- IDF< 1 %
- Replacer< 1 %
- Wildcard Tagger< 1 %
- POS Tagger< 1 %
- Stanford Tagger< 1 %
Bag of Words Creator< 1 %- Document Vector< 1 %
Meta Info Extractor< 1 %- Strings to Document< 1 %
- Tags to String< 1 %
- Term Neighborhood Extractor< 1 %
- Term to String< 1 %
- Google Sheets Writer< 1 %
- Column Filter (legacy)< 1 %
- Line Plot (JavaScript)< 1 %
- Table Editor (JavaScript)< 1 %
- Table to JSON< 1 %
- Network Creator< 1 %
- Network Viewer< 1 %
- Multiobjective Score Computation< 1 %
Python Script (1⇒1)< 1 %Python View< 1 %- Python Script (legacy)< 1 %
- R View (Table)< 1 %
- Moving Aggregator< 1 %
Views
- This node has no views
Workflows
00_Topic_Modeling_with_Verified_ComponentsKNIME Hub- 00_Topic_Modeling_with_Verified_ComponentsKNIME Hub
- 01_Simple_tag_cloud_and_networkKNIME Hub
- 01_Simple_tag_cloud_and_networkKNIME Hub
- 01_Simple_tag_cloud_and_networkKNIME Hub
- Show all 297 workflows
Links
- Text processing and comparison of two different set of documentsby HansS on 2019-08-04forum.knime.com/p/67111
- Identifying Similar Listings Across Multiple Tables with Varying Informationby izaychik63 on 2024-02-18forum.knime.com/p/249968
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.