Icon

KNIME_​Webscrape_​COVID_​Victoria_​Numbers

Web Scrape Example COVID-19 Outbreak Victoria
Scrape Active cases over time:Open the webpage https://covidlive.com.au/report/daily-active-cases/vic , parse table and turn into some data Scrape Active for Local Government Area:This is exactly the same process since we take the variable names from the XML I was interested in learning about how do a basic webscrape for data during lockdown using Knime. I'm scraping this dataand making a visualisation in tableu public here: https://public.tableau.com/profile/damian.frankcom#!/vizhome/COVIDVICMap/COVIC-19VIC Connect to webstie and get XMLParse the XML to extract the table Transform the table into a data fileexpand out the list made in the pivot(work around for not having a groupfor pivot) Node 12Node 13Node 14Node 15Node 16You can write this table to whereever you like Webpage Retriever XPath Pivoting Ungroup Ungroup Pivoting XPath Webpage Retriever Excel Writer (XLS) Table View Scrape Active cases over time:Open the webpage https://covidlive.com.au/report/daily-active-cases/vic , parse table and turn into some data Scrape Active for Local Government Area:This is exactly the same process since we take the variable names from the XML I was interested in learning about how do a basic webscrape for data during lockdown using Knime. I'm scraping this dataand making a visualisation in tableu public here: https://public.tableau.com/profile/damian.frankcom#!/vizhome/COVIDVICMap/COVIC-19VIC Connect to webstie and get XMLParse the XML to extract the table Transform the table into a data fileexpand out the list made in the pivot(work around for not having a groupfor pivot) Node 12Node 13Node 14Node 15Node 16You can write this table to whereever you likeWebpage Retriever XPath Pivoting Ungroup Ungroup Pivoting XPath Webpage Retriever Excel Writer (XLS) Table View

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: damof
Created at: 2020-07-18
On NodePit since: 2020-07-18
Last update: 2024-11-23
Created with KNIME version: v4.1.2
Tags: COVID19

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!