Icon

JKISeason3-9_​RBre

Web Scraping and Analyzing Economic News

Challenge 9
Level: Medium

Description: Recently you became more interested in finance, and since you want to learn more about web scraping for work, you decided to unite both interests. Using the KNIME Web Interaction extension, can you navigate to the Economic News section on Yahoo Finance, extract the headers of only the most recent topics that pop up on the webpage, and then make sense of the results visually? Remember to filter out any ads or unrelated banners/headers/content. Hint: Find class tags in the news' XML that are unique to the content you are scraping.

Author: Thor Landstrom

URL: Yahoo Finance https://finance.yahoo.com/topic/economic-news/?guccounter=1

Node 1Node 2Node 4Node 10Node 11Node 12Node 13Node 17Node 18Node 19Node 20Node 21Node 22Node 23AINVIDIANode 26create a link Node 31Node 32Web InteractionStart Web Interaction End Navigator Content Retriever Clicker Clicker Clicker Row Filter String Manipulation Column Filter Cell Splitter Cell Splitter String Manipulation String Manipulation String Manipulation Math Formula Row Filter String Manipulation Table View(JavaScript) Column Resorter Excel Writer Node 1Node 2Node 4Node 10Node 11Node 12Node 13Node 17Node 18Node 19Node 20Node 21Node 22Node 23AINVIDIANode 26create a link Node 31Node 32Web InteractionStart Web Interaction End Navigator Content Retriever Clicker Clicker Clicker Row Filter String Manipulation Column Filter Cell Splitter Cell Splitter String Manipulation String Manipulation String Manipulation Math Formula Row Filter String Manipulation Table View(JavaScript) Column Resorter Excel Writer

Nodes

Extensions

Links