9 workflows in this folder and its subfolders
January 2020 · This workflow shows how article URLs can be extracted from paginated overview pages (as typically known from news websites and blogs) using a recursive loop. The example uses the Ars Technica website, but the workflow can be easily adapted to your needs: (1) Specify a start URL, (2) specify an XPath…
September 2020 · This workflow scrapes a list of current public HTTP proxies www.proxynova.com and then for each proxy server makes a test request to icanhazip.com to check whether the proxy is working fine. Requires Palladian 2.4+, where the HTTP Retriever’s node dialog has a tab “Proxy”. The setting there override…
November 2022 · Scrape a list of cities with the coordinates and population numbers from Wikipedia using the Selenium Nodes and visualize them in different styles using the Map Viewer node from Palladian. The Map Viewer supports the Color Manager and Size Manager nodes to set the colors and sizes of the markers sho…
Read some sample data with US pizzerias provided by the following Google tutorial: https://developers.google.com/maps/articles/phpsqlsearch_v3. Note that this data already provides latitude/longitude values for the given addresses, in this example however, we want to demonstrate the geocoding nodes,…