Icon

HttpRetriever_​Proxy_​Server

Palladian_HttpRetriever_Proxy_Server

This workflow scrapes a list of current public HTTP proxies www.proxynova.com and then for each proxy server makes a test request to icanhazip.com to check whether the proxy is working fine.

Requires Palladian 2.4+, where the HTTP Retriever’s node dialog has a tab “Proxy”. The setting there overrides the system’s or KNIME’s default proxy settings.

Node 10Test URLicanhazip.comto get currentIP addressNode 12Node 13Node 14Node 16Node 17Node 18Scrape www.proxynova.comCheck if requestwas successfull (i.e. 200) -- in thiscase assume thatthe proxy serverworks wellTable Row ToVariable Loop Start Table Creator HTTP Retriever HTTP ResultData Extractor Loop End Variable toTable Row Cross Joiner Column Filter GET PROXY LIST Row Filter Node 10Test URLicanhazip.comto get currentIP addressNode 12Node 13Node 14Node 16Node 17Node 18Scrape www.proxynova.comCheck if requestwas successfull (i.e. 200) -- in thiscase assume thatthe proxy serverworks wellTable Row ToVariable Loop Start Table Creator HTTP Retriever HTTP ResultData Extractor Loop End Variable toTable Row Cross Joiner Column Filter GET PROXY LIST Row Filter

Nodes

Extensions

Links