Icon

SQLite Update Puzzle

Cleaning, replacing, or fixing input values Square footage alignment Create a DB to store lats & lons retrievedfrom Google Open LatLon DB Append listings with LatLon, retrieve from Google only when new Create a DB to new or updated real estate listings, then connect to green series of nodes to the right Example constituent CSVs (to be replaced by nodes in redcontainer). Pulls can be either incremental since last pull, orfull download. Node(s) here would retrieve the updated data table (sincebeginning of time), but realizing that a real estate listing couldbe updated and present on a new line. A unique listing isdetermined by the ML Number column. If the ML Number is thesame, and all other columns are the same, then it ispresumed the rows can be merged. If the ML Number is thesame, but some other column has changed - then the listinghas been updated in some way. Node 1Node 2Remove emptycolumnsPostal Codesto LatLonAll Inclsv to N if blank;Approx Age TBD if blankChange 0 Age to NewSplit SqFt RangeRenaming SqFtColumnsCalc SqFt MidpointSplit LatLonto Lat & LonIf 0sqft then349sqftFix datesNo locker toN caseY locker to just YNode 26Node 27Store LatLonNode 29Node 30Node 31Node 32only geo-code the uniquevalues to prevent superfluousrequestsNode 277Node 279Node 280Node 281Node 282Node 283Node 285Node 286Node 287Node 290Node 291Node 293Node 294Node 295Node 296Node 297Pull 01Pull 02 SQLite Connector DB Table Creator Missing ValueColumn Filter Google AddressGeocoder Missing Value String Replacer Cell Splitter Column Rename Math Formula Coordinate toLatitude/Longitude Rule Engine String to Date&Time String Manipulation Rule Engine SQLite Connector DB Table Creator DB Merge DB Table Selector DB Query DB Reader Joiner GroupBy Joiner Column Filter String To Number DB Table Selector DB Query DB Reader List Files/Folders String to URI String Manipulation File MetaInfo (legacy) Sorter CSV Reader Row Filter Table Rowto Variable Column Filter DB Insert Table Creator Table Creator Cleaning, replacing, or fixing input values Square footage alignment Create a DB to store lats & lons retrievedfrom Google Open LatLon DB Append listings with LatLon, retrieve from Google only when new Create a DB to new or updated real estate listings, then connect to green series of nodes to the right Example constituent CSVs (to be replaced by nodes in redcontainer). Pulls can be either incremental since last pull, orfull download. Node(s) here would retrieve the updated data table (sincebeginning of time), but realizing that a real estate listing couldbe updated and present on a new line. A unique listing isdetermined by the ML Number column. If the ML Number is thesame, and all other columns are the same, then it ispresumed the rows can be merged. If the ML Number is thesame, but some other column has changed - then the listinghas been updated in some way. Node 1Node 2Remove emptycolumnsPostal Codesto LatLonAll Inclsv to N if blank;Approx Age TBD if blankChange 0 Age to NewSplit SqFt RangeRenaming SqFtColumnsCalc SqFt MidpointSplit LatLonto Lat & LonIf 0sqft then349sqftFix datesNo locker toN caseY locker to just YNode 26Node 27Store LatLonNode 29Node 30Node 31Node 32only geo-code the uniquevalues to prevent superfluousrequestsNode 277Node 279Node 280Node 281Node 282Node 283Node 285Node 286Node 287Node 290Node 291Node 293Node 294Node 295Node 296Node 297Pull 01Pull 02SQLite Connector DB Table Creator Missing ValueColumn Filter Google AddressGeocoder Missing Value String Replacer Cell Splitter Column Rename Math Formula Coordinate toLatitude/Longitude Rule Engine String to Date&Time String Manipulation Rule Engine SQLite Connector DB Table Creator DB Merge DB Table Selector DB Query DB Reader Joiner GroupBy Joiner Column Filter String To Number DB Table Selector DB Query DB Reader List Files/Folders String to URI String Manipulation File MetaInfo (legacy) Sorter CSV Reader Row Filter Table Rowto Variable Column Filter DB Insert Table Creator Table Creator

Nodes

Extensions

Links