Icon

Just KNIME It S03 _​ CH09 _​ Web Scraping and Analyzing Economic News

Recently you became more interested in finance, and since you want to learn more about web scraping for work, you decided to unite both interests. Using the KNIME Web Interaction extension, can you navigate to the Economic News section on Yahoo Finance, extract the headers of only the most recent topics that pop up on the webpage, and then make sense of the results visually? Remember to filter out any ads or unrelated banners/headers/content. Hint: Find class tags in the news' XML that are unique to the content you are scraping.

Author: Thor Landstrom

Just KNIME It - Season3 - Challenge 09: Filtering Redundant Folder Referenceshttps://hub.knime.com/-/spaces/-/~dQDQxaa2Vedo4CaW/current-state/ JKI S03 CH 09 Results open Google Chromenavigate to https://finance.yahoo.com/topic/economic-news/decline coockiesfrom @berti093read images from https://finance.yahoo.com/news/*close Google Chromebrowsercompile [images_URL] set variable$images_URL$ to setretrieve web site 'page'contents@jm1950sjrtypesourcewhentitleheaderlinkimageinclude https://finance.yahoo.com/news/*resetresetappend imagesdisplay yahoo finance news in tile viewrender images to SVGsort for tilescolor by typeembet link in tittle@sryu Web InteractionStart Navigator Clicker Image Reader Web Interaction End Table Rowto Variable GroupBy Content Retriever XPath XPath Row Filter RowID RowID Column Appender Tile View(JavaScript) Renderer to Image Column Resorter Color Manager String Manipulation Just KNIME It - Season3 - Challenge 09: Filtering Redundant Folder Referenceshttps://hub.knime.com/-/spaces/-/~dQDQxaa2Vedo4CaW/current-state/ JKI S03 CH 09 Results open Google Chromenavigate to https://finance.yahoo.com/topic/economic-news/decline coockiesfrom @berti093read images from https://finance.yahoo.com/news/*close Google Chromebrowsercompile [images_URL] set variable$images_URL$ to setretrieve web site 'page'contents@jm1950sjrtypesourcewhentitleheaderlinkimageinclude https://finance.yahoo.com/news/*resetresetappend imagesdisplay yahoo finance news in tile viewrender images to SVGsort for tilescolor by typeembet link in tittle@sryu Web InteractionStart Navigator Clicker Image Reader Web Interaction End Table Rowto Variable GroupBy Content Retriever XPath XPath Row Filter RowID RowID Column Appender Tile View(JavaScript) Renderer to Image Column Resorter Color Manager String Manipulation

Nodes

Extensions

Links