Icon

403-sites-using-selenium-23919

Instead of Find Elements + Extract Attribute, use a single JavaScript snippet:https://forum.knime.com/t/workaround-for-403-errors/23919/5 CrawlSites Test SitesNode 1375Node 1377Node 1381Node 1382Node 1383Node 1384Node 1386Node 1403Node 1404Node 1405Extract all <a> tag’s href attributesand return resultas JSON arrayParse JSONSplit arraySplit into rowsHTTP Retriever Table Creator Start WebDriver Find Elements Navigate Loop End Quit WebDriver Variable toTable Row Current URL Extract Attribute Table Row ToVariable Loop Start Cross Joiner Execute JavaScript String to JSON JSON Path Ungroup Instead of Find Elements + Extract Attribute, use a single JavaScript snippet:https://forum.knime.com/t/workaround-for-403-errors/23919/5 CrawlSitesTest SitesNode 1375Node 1377Node 1381Node 1382Node 1383Node 1384Node 1386Node 1403Node 1404Node 1405Extract all <a> tag’s href attributesand return resultas JSON arrayParse JSONSplit arraySplit into rowsHTTP Retriever Table Creator Start WebDriver Find Elements Navigate Loop End Quit WebDriver Variable toTable Row Current URL Extract Attribute Table Row ToVariable Loop Start Cross Joiner Execute JavaScript String to JSON JSON Path Ungroup

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Philipp Katz
Created at: 2020-05-19
On NodePit since: 2020-05-22
Last update: 2024-11-17
Created with KNIME version: v4.1.3
NodePit Exclusive Only available on NodePit

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!