Icon

Palladian

9 workflows in this folder and its subfolders

Icon
Crawl-pages-with-pagination

January 2020 · This workflow shows how article URLs can be extracted from paginated overview pages (as typically known from news websites and blogs) using a recursive loop. The example uses the Ars Technica website, but the workflow can be easily adapted to your needs: (1) Specify a start URL, (2) specify an XPath…

Icon
HttpRetriever_​Proxy_​Server

September 2020 · This workflow scrapes a list of current public HTTP proxies www.proxynova.com and then for each proxy server makes a test request to icanhazip.com to check whether the proxy is working fine. Requires Palladian 2.4+, where the HTTP Retriever’s node dialog has a tab “Proxy”. The setting there override…

Icon
Map_​Viewer_​Example_​Advanced

November 2022 · Scrape a list of cities with the coordinates and population numbers from Wikipedia using the Selenium Nodes and visualize them in different styles using the Map Viewer node from Palladian. The Map Viewer supports the Color Manager and Size Manager nodes to set the colors and sizes of the markers sho…

Icon
Palladian_​Geocoder_​Pizzerias

Read some sample data with US pizzerias provided by the following Google tutorial: https://developers.google.com/maps/articles/phpsqlsearch_v3. Note that this data already provides latitude/longitude values for the given addresses, in this example however, we want to demonstrate the geocoding nodes,…