Icon

01_​Twitter_​meets_​PostgreSQL

Will they blend? Twitter and PostgreSQL Database

This is a mini-workflow for Data WareHousing, in particular it archiviates daily tweets. History is saved in a PostgreSQL database (but it could be any database). This workflow is supposed to run every day. Every day it collects yesterday's tweets from Twitter and last month's tweets from a PostgreSQL database and blends them together to produce the tag cloud of the month. ... and yes! They blend.

This workflow demonstrates how data from Twitter and a PostgreSQL database can be combined (blended) to create a tag cloud Accessing PostGreSQL Database Accessing Twitter Connect to TwitterNeeds API Key and Access Tokenfrom a Twitterdeveloper accountrecent tweetsdisplay word cloudcontent from last monthincluding todayword frequencyandcleaning uponly yesterday'stweetsOne Month AgoYesterdayDay before YesterdayTodaytodouble(yyyyMMdd)SELECT *from tweetsextract data from DBwith input queryupdate table"tweets" with yesterday's tweetstime >one month agotime <= before yesterdaywrite wordcloud imageto filehashtags or wordsto searchconnect to PostgreSQL DBChange this connectornode to connect toanother database Twitter APIConnector Twitter Search Tag Cloud Concatenate Word Frequency Row Filter Time Parameters Date Conversion DB Table Selector DB Reader DB Writer DB Row Filter DB Row Filter Image Writer (Port) StringConfiguration PostgreSQLConnector This workflow demonstrates how data from Twitter and a PostgreSQL database can be combined (blended) to create a tag cloud Accessing PostGreSQL Database Accessing Twitter Connect to TwitterNeeds API Key and Access Tokenfrom a Twitterdeveloper accountrecent tweetsdisplay word cloudcontent from last monthincluding todayword frequencyandcleaning uponly yesterday'stweetsOne Month AgoYesterdayDay before YesterdayTodaytodouble(yyyyMMdd)SELECT *from tweetsextract data from DBwith input queryupdate table"tweets" with yesterday's tweetstime >one month agotime <= before yesterdaywrite wordcloud imageto filehashtags or wordsto searchconnect to PostgreSQL DBChange this connectornode to connect toanother databaseTwitter APIConnector Twitter Search Tag Cloud Concatenate Word Frequency Row Filter Time Parameters Date Conversion DB Table Selector DB Reader DB Writer DB Row Filter DB Row Filter Image Writer (Port) StringConfiguration PostgreSQLConnector

Nodes

Extensions

Links