Icon

HttpRetriever_​Proxy_​Server

Palladian_HttpRetriever_Proxy_Server

This workflow scrapes a list of current public HTTP proxies www.proxynova.com and then for each proxy server makes a test request to icanhazip.com to check whether the proxy is working fine.

Requires Palladian 2.4+, where the HTTP Retriever’s node dialog has a tab “Proxy”. The setting there overrides the system’s or KNIME’s default proxy settings.

Node 10Test URLicanhazip.comto get currentIP addressNode 12Node 13Node 14Node 16Node 17Node 18Scrape www.proxynova.comCheck if requestwas successfull (i.e. 200) -- in thiscase assume thatthe proxy serverworks wellTable Row ToVariable Loop Start Table Creator HTTP Retriever HTTP ResultData Extractor Loop End Variable toTable Row Cross Joiner Column Filter GET PROXY LIST Row Filter Node 10Test URLicanhazip.comto get currentIP addressNode 12Node 13Node 14Node 16Node 17Node 18Scrape www.proxynova.comCheck if requestwas successfull (i.e. 200) -- in thiscase assume thatthe proxy serverworks wellTable Row ToVariable Loop Start Table Creator HTTP Retriever HTTP ResultData Extractor Loop End Variable toTable Row Cross Joiner Column Filter GET PROXY LIST Row Filter

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Philipp Katz
Created at: 2020-09-30
On NodePit since: 2020-09-30
Last update: 2024-11-17
Created with KNIME version: v4.0.2
Tags: palladianhttpproxy
NodePit Exclusive Only available on NodePit

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!