1 ×

HTML Parser

Palladian for KNIME version 2.3.0.202009251618 by palladian.ws; Philipp Katz, Klemens Muthmann, David Urbansky

This HTML parser is based on Validator.nu.

Quotation from the web page: The Validator.nu HTML Parser is an implementation of the HTML5 parsing algorithm in Java. The parser is designed to work as a drop-in replacement for the XML parser in applications that already support XHTML 1.x content with an XML parser and use SAX, DOM or XOM to interface with the parser. Low-level functionality is provided for applications that wish to perform their own IO and support document.write() with scripting. The parser core compiles on Google Web Toolkit and can be automatically translated into C++. (The C++ translation capability is currently used for porting the parser for use in Gecko.)

You can supply input to this node in a variety of formats:

  • HTTP Result cells which you obtained with the “HTTP Retriever” node
  • Binary data cells
  • String cells which contain a local file: URL; note that although technically possible, it is not recommended to input http: or https: URLs directly into the parser. Use the “HTTP Retriever” for downloading instead and input the HTTP Results into this node to guarantee proper encoding.
  • String cells which contain the raw markup (e.g. <html><head> […] )

“Infotising”: This node is only intended for “static” HTML structures. If you need to work with interactive web pages and web apps which are dynamically generated client-side in the browser, have a look at our plugin “Selenium Nodes”.

Options

Input
Column in the input table which holds the data to parse.
Drop input column
Enable to exclude the input column from the result table.
Make absolute URLs
When enabled, all relative URLs in the document are converted to absolute ones. This simplifies/permits further processing steps with the URLs obtained from the document.

Input Ports

Icon
Input table containing (X)HTML data to be parsed.

Output Ports

Icon
Output table with parsed (X)HTML documents appended. In case, a document could not be parsed, a “missing value” is appended.

Best Friends (Incoming)

Best Friends (Outgoing)

Workflows

Installation

To use this node in KNIME, install Palladian for KNIME from the following update site:

KNIME 4.2

A zipped version of the software site can be downloaded here. Read our FAQs to get instructions about how to install nodes from a zipped update site.

Wait a sec! You want to explore and install nodes even faster? We highly recommend our NodePit for KNIME extension for your KNIME Analytics Platform.

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.