Extracts WebElements based on different criteria. The input can either be a WebDriver (representing a browser’s window), or a WebElement (a subpart of the window). The following search criteria are available:
| Find by | Explanation |
|---|---|
| Class Name | Finds elements based on their class attributes. In case an element
has multiple class values assigned, matching a single value is sufficient. |
| CSS Selector | Finds elements based on a CSS selector expression. |
| ID | Finds an element based in its id attribute. |
| Link Text | Finds links through an exact match of their text. |
| Name | Finds elements based on their name attributes. |
| Partial Link Text | Finds links by a partial match of the given text. |
| Tag Name | Finds elements based on their tag names. |
| XPath | Finds elements based on an XPath expression. (see e.g. here for a introduction to XPath) |
You can use the “Outline” view to easily create selector queries from the current DOM tree: Find the element you want to extract and double click on the corresponding line. A matching selector expression will be automatically inserted into the “Query” field.
Alternatively, you can select elements directly in the browser (works for Chromium-based browsers Chrome, Chromium): Click the “Select” button beside the “Query” input, switch to your browser window, and select any element on the page. A selector expression will be inserted into the “Query” field.
Please note that these feature require (1) a running browser instance which must show the actual data you want to extract, (2) the “full input data” to the node to be available.
To search for a text snippet within the DOM tree, use the search bar below the source.
For each extracted WebElement a new row is added to the output table.
Note that you cannot only search within the given input, but also navigate the entire DOM tree.
For example, you can use the XPath query .. to find a WebElement’s parent.
Also note that you can only find on a DOM element level here, but not text content or attributes. To extract text, use this node to select the surrounding element, and then connect an “Extract InnerHTML” node to get the text. To extract attribute values, use an “Extract Attribute” node accordingly.
Options
Popular Successors
- Extract Text7 %
- Click5 %
Click3 %- Find Elements3 %
- Send Keys3 %
Submit3 %Joiner2 %Extract CSS Property2 %- Try (Data Ports)2 %
- Extract Attribute2 %
- Loop End2 %
Loop End2 %- Cross Joiner1 %
- String Manipulation1 %
- Clear1 %
Table Extractor1 %- Wait1 %
- Column Filter1 %
Row Filter (deprecated)1 %- Catch Errors (Data Ports)1 %
Table Writer1 %Counting Loop Start1 %Column Rename1 %- HTML Node to Text1 %
- Alert1 %
- Send File Path1 %
- Table Creator< 1 %
- Java Snippet< 1 %
- Counting Loop Start< 1 %
- Chunk Loop Start< 1 %
- Table Row to Variable Loop Start< 1 %
- Concatenate< 1 %
- Cell Splitter< 1 %
Column Appender< 1 %- Column Appender< 1 %
- Table Manipulator< 1 %
- Empty Table Switch< 1 %
- Extract Table Dimension< 1 %
- HTML Parser< 1 %
Extract Attribute< 1 %- Extract CSS Property< 1 %
- Current URL< 1 %
- Frame< 1 %
Extract Outer/InnerHTML< 1 %- Execute JavaScript< 1 %
- Navigate< 1 %
- Page Source< 1 %
- Quit WebDriver< 1 %
- Take Screenshot< 1 %
- Select< 1 %
- Table Extractor< 1 %
- Window< 1 %
- Wait...< 1 %
Table Row To Variable Loop Start< 1 %- Constant Value Column< 1 %
- GroupBy< 1 %
Execute JavaScript< 1 %- Submit< 1 %
- Read Images< 1 %
- String to Number< 1 %
- IF Switch< 1 %
Excel Writer (XLS)< 1 %- Generic JavaScript View (JavaScript)< 1 %
- String to XML< 1 %
- Web Page Content Extractor< 1 %
Send Keys< 1 %- Variable to Table Column< 1 %
- Table Row to Variable< 1 %
- Column List Loop Start< 1 %
- Group Loop Start< 1 %
Recursive Loop Start< 1 %- String Splitter (Regex)< 1 %
- String Manipulation (Variable)< 1 %
- String Replacer< 1 %
- Rule-based Row Filter< 1 %
- Rule Engine< 1 %
- Rule-based Row Splitter< 1 %
- End IF< 1 %
- Excel Writer< 1 %
- Container Output (JSON)< 1 %
- Column to XML< 1 %
Clear< 1 %Click< 1 %Drag and Drop< 1 %- Start WebDriver< 1 %
IF Switch (Flow Variable Value)< 1 %- Inject Variables (Data)< 1 %
Table Column to Variable< 1 %CSV Writer< 1 %Loop End (2 ports)< 1 %Recursive Loop End< 1 %- Variable Loop End< 1 %
Concatenate (Optional in)< 1 %- Extract Missing Value Cause< 1 %
- Missing Value< 1 %
- String Manipulation (Multi Column)< 1 %
- TimeDelay Loop End< 1 %
- Column Expressions< 1 %
- Item Set Finder (Borgelt)< 1 %
Excel Writer (XLS)< 1 %- Java Snippet (simple)< 1 %
- RSS Feed Reader< 1 %
- Term to String< 1 %
- Table to JSON< 1 %
- JSON to Table< 1 %
- Image Viewer< 1 %
- Python View (legacy)< 1 %
- XPath< 1 %
- HTTP Retriever< 1 %
- Bulk RemoteWebDriver Factory< 1 %
- Highlight< 1 %
- Synchronize< 1 %
Table Extractor< 1 %
Views
- This node has no views
Workflows
20210201 ExtractPic_LoopKNIME Forum- 20210201 ExtractPic_Loop_30365NodePit Space
- 403 sites using SeleniumKNIME Forum
- 403-sites-using-selenium-23919NodePit Space
- Basic web scraping exampleKNIME Hub
- Show all 90 workflows
Links
- Downloading web tableby qqilihq on 2019-12-02forum.knime.com/p/75965
- g element Xpathby qqilihq on 2021-10-06forum.knime.com/p/136400
- Selenium Nodes: All Loop Iterations Repeat First Page Contentby qqilihq on 2019-02-24forum.knime.com/p/55069
- Iterate through WebElements fails after first elementsby qqilihq on 2021-10-17forum.knime.com/p/137150
- Selenium Nodes: How to scroll within a section?by qqilihq on 2021-03-20forum.knime.com/p/119029
- Show all 21 links
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.