Icon

GenAI for Summarization - Forum Posts

<p><strong>GenAI for Summarization: Forum Posts</strong></p><ul><li><p>This workflow retrieves the top 10 questions by no. of votes and the corresponding answers from StackOverflow.</p><p></p></li><li><p>It prompts an LLM to summarize both the content of questions and answers.</p><p></p></li><li><p>It stores summaries, URLs to source content and other information in a MongoDB database.</p></li></ul>

URL: KNIME for Generative AI https://hub.knime.com/c/D4ckx2q_J5FPBQXu

2. Prompt LLM
1. Access Data
3. Deploy Results

GenAI for Summarization: Forum Posts

  • This workflow retrieves the top 10 questions by no. of votes and the corresponding answers from StackOverflow.

  • It prompts an LLM to summarize both the content of questions and answers.

  • It stores summaries, URLs to source content and other information in a MongoDB database.

Set up a local MongoDB Community Edition instance for free, following this guide: https://www.mongodb.com/docs/manual/administration/install-community/

Create JSONstructure of dataset
Table to JSON
Retrieve full texts
Questions & Answers
Split question and answersummaries to separatecolumns
Post-processing
Connect to a localinstance of MongoDB
MongoDB Connector
LLM Prompter
Prompt engineering
Expression
OpenAI API key
Credentials Configuration
OpenAI Authenticator
Get questions fromStackOverflow from Jan 1st, 2000onwards
GET Request
MongoDB Writer
Select model,e.g., gpt-4o-mini
OpenAI Chat Model Connector
Keep top 10questions bynum. of votes
Parsing questions
Inspect summaries
Table View

Nodes

Extensions

Links