Icon

JKISeason3-9_​tark

Web Scraping and Analyzing Economic News

Level: Medium

Description: Recently you became more interested in finance, and since you want to learn more about web scraping for work, you decided to unite both interests. Using the KNIME Web Interaction extension, can you navigate to the Economic News section on Yahoo Finance, extract the headers of only the most recent topics that pop up on the webpage, and then make sense of the results visually? Remember to filter out any ads or unrelated banners/headers/content. Hint: Find class tags in the news' XML that are unique to the content you are scraping.

Author: Thor Landstrom

URL: JKISeason3-9 https://www.knime.com/just-knime-it?pk_vid=f1a9625dd14a14c5171698895027e10b
URL: This challenge thread https://forum.knime.com/t/solutions-to-just-knime-it-challenge-9-season-3/81017?pk_vid=4f4fa4eaba8284ca1720937839c79179

https://finance.yahoo.com/topic/economic-news/HeadinghrefFilter by *finance.yahoo.com/news*Close web browserNode 886Create linkNavigator Web InteractionStart Content Retriever XPath Row Filter Web Interaction End Table View(JavaScript) String Manipulation https://finance.yahoo.com/topic/economic-news/HeadinghrefFilter by *finance.yahoo.com/news*Close web browserNode 886Create linkNavigator Web InteractionStart Content Retriever XPath Row Filter Web Interaction End Table View(JavaScript) String Manipulation

Nodes

Extensions

Links