Icon

You can do Magic

Step 1: extract links to all relevant subpages InfoThis workflow is a joint development of the Selenium Nodes Team and Phil Kowalski. You will find the KNIME forum post here:Additionally see this video on YouTube:The base URL for this workflow is the Ulisses DSA Regelwiki, a great resource for all German roleplayers wanting to use the most successful RPG in Germany. Youfind the Regelwiki here: https://ulisses-regelwiki.de/ Step 2: scrape the individual ZS links and extract HTML source code of each Step 3: Extract the properties from each downloaded HTML document and prep for WorldAnvil (BBCode) Step 4: Log in to WorldAnvil Step 5: Publish the prepared content to World Anvil define web driver / browserstartChrome(SE) &Call URLfind links to individual subpages andextractquit Chromeand delWeb Driver colextract ZSfileameexclude allnon ZS_filesremovehelpercolcorrectUmlaut errorsexport Link List toExcelstart theloop based on found individualpages from step 1turnlink > varstart Chromeextract the entire HTML source codeof the web pageend loopthrough ZS linksnavigateto providedZS linkquit Chromeand delWeb Driver colParse theHTML sourceextract the<div> containingthe textextractZS propertiestrim thetitle prefixapplyBBCode for publishing atWorld Anviladd toexisting Excel filestart looping through thelinesgo toWorld AnvilLogin Pageenteruser nameenterpasswordclicksubmitgo to new article pagesend articletitle (var)from listclick source codebutton(needed for BBCode)sendcontent intotext areaclickNavigationmenu buttonlocate theParent Categorydropdownselect"Zaubersprüche"from the listclick theDraft / Publishswitchclick theSave Changesbuttonwait1 secendloopWebDriver Factory Start WebDriver Extract Attribute Quit WebDriver String Manipulation Row Filter Column Filter String Manipulation Excel Writer Chunk Loop Start Table Rowto Variable Start WebDriver Page Source Loop End Navigate Quit WebDriver HTML Parser XPath XPath String Manipulation(Multi Column) String Manipulation Excel Writer Table Row ToVariable Loop Start Start WebDriver Send Keys Send Keys Click Navigate Send Keys Click Send Keys Click Find Elements Select Click Click Wait Loop End Quit WebDriver Step 1: extract links to all relevant subpages InfoThis workflow is a joint development of the Selenium Nodes Team and Phil Kowalski. You will find the KNIME forum post here:Additionally see this video on YouTube:The base URL for this workflow is the Ulisses DSA Regelwiki, a great resource for all German roleplayers wanting to use the most successful RPG in Germany. Youfind the Regelwiki here: https://ulisses-regelwiki.de/ Step 2: scrape the individual ZS links and extract HTML source code of each Step 3: Extract the properties from each downloaded HTML document and prep for WorldAnvil (BBCode) Step 4: Log in to WorldAnvil Step 5: Publish the prepared content to World Anvil define web driver / browserstartChrome(SE) &Call URLfind links to individual subpages andextractquit Chromeand delWeb Driver colextract ZSfileameexclude allnon ZS_filesremovehelpercolcorrectUmlaut errorsexport Link List toExcelstart theloop based on found individualpages from step 1turnlink > varstart Chromeextract the entire HTML source codeof the web pageend loopthrough ZS linksnavigateto providedZS linkquit Chromeand delWeb Driver colParse theHTML sourceextract the<div> containingthe textextractZS propertiestrim thetitle prefixapplyBBCode for publishing atWorld Anviladd toexisting Excel filestart looping through thelinesgo toWorld AnvilLogin Pageenteruser nameenterpasswordclicksubmitgo to new article pagesend articletitle (var)from listclick source codebutton(needed for BBCode)sendcontent intotext areaclickNavigationmenu buttonlocate theParent Categorydropdownselect"Zaubersprüche"from the listclick theDraft / Publishswitchclick theSave Changesbuttonwait1 secendloopWebDriver Factory Start WebDriver Extract Attribute Quit WebDriver String Manipulation Row Filter Column Filter String Manipulation Excel Writer Chunk Loop Start Table Rowto Variable Start WebDriver Page Source Loop End Navigate Quit WebDriver HTML Parser XPath XPath String Manipulation(Multi Column) String Manipulation Excel Writer Table Row ToVariable Loop Start Start WebDriver Send Keys Send Keys Click Navigate Send Keys Click Send Keys Click Find Elements Select Click Click Wait Loop End Quit WebDriver

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: kowisoft_local
Created at: 2021-03-16
On NodePit since: 2021-11-15
Last update: 2024-10-17
Created with KNIME version: v4.3.2

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!