Table Extractor

This node conveniently converts HTML tables into KNIME tables. It uses some simple heuristics to determine the column names. The result are three KNIME tables. The first KNIME table contains the HTML table’s content, the second and third KNIME tables contain the HTML table’s header and footer.

As KNIME supports no spanning rows or columns, rowspan and colspan attributes in the HTML table are mapped by simply copying the original cell’s content to the spanning cells.

The HTML table’s header is detected by checking, whether (1) all cells are of type th, or (2) the cells are contained within a thead element. The HTML table’s footer is detected through the tfoot element.

The KNIME table’s column names are generated from HTML table’s header. In case the header is a single row, the column names equal the HTML table’s header names. In case there is more than one row in the HTML table’s header, the rows are concatenated with “ > ”. In case the HTML table contains no header, the column names are synthetically generated (“column0”, “column1”, …)

Here’s an example HTML table:

Header A
Header B	Header C	Header D
Cell 1	Cell 2	Cell 3
Cell 4	Cell 5
Cell 4	Cell 6	Cell 7

This will result in the following KNIME content table:

Header A > Header B	Header A > Header C	Header A > Header D
Cell 1	Cell 2	Cell 3
Cell 4	Cell 5	Cell 5
Cell 4	Cell 6	Cell 7

And the KNIME header table:

Header A > Header B	Header A > Header C	Header A > Header D
Header A	Header A	Header A
Header B	Header C	Header D

The footer table would be empty in this example, because the HTML table contains no footer.

Options

Search Mode

Select “Input Column” if your input table already contains the WebElement which you want to use. Otherwise select “Find Element(s)” to open a picker dialog which allows you to chose the WebElement(s). For more information about the dialog, please check the documentation of the “Find Elements” node.

Input

(when mode is “Input Column”) Input column which provides the WebElement(s)

Remove input column

(when mode is “Input Column”) Removes the input column from the result table

Selector

(when mode is “Find Element(s)”) Click the “Edit” button to open the picker dialog.

Property

Select which property to extract

innerHTML: The inner HTML markup of each cell
outerHTML: The outer HTML markup of each cell (same as innerHTML, but including the cell’s own markup as well)
innerText: The rendered text content of the cell (consider it as the result a user would get if they highlighted the cell with the cursor and copied the text to their clipboard)
textContent: The text content of the cell (in contrast to innerText) including e.g. parts which are invisible

Treat rowspan and colspan as missing cells

Enable to empty strings or missing values (depending on next settings) for rowspan or colspan cells instead of repeating the original value.

Create missing values for missing cells

If this option is checked, missing value cells (instead of empty string cells) will be created for those cells, which are not explicitly defined within the HTML table.

Skip empty rows

Enable to skip entirely empty rows from the output tables.

Input Ports

: Table with a column providing a WebElement which resembles the table to extract

Output Ports

: The table content
: The table’s header data
: The table’s footer data

Popular Predecessors

No recommendations found

Popular Successors

No recommendations found

Views

This node has no views

Workflows

No workflows found

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.

Installation

To use this node in KNIME, install the extension Selenium Nodes for KNIME from the below update site following our NodePit Product and Node Installation Guide:

v5.3

A zipped version of the software site can be downloaded here.

Plugin provider: seleniumnodes.com

Plugin version: 5.8.3.202409021954

On NodePit since: 2024-07-10

Last update: 2024-09-07

KNIME versions: Since v4.7

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!