Go to Product
This node allows to transform URLs to a canonicalized representation, e. g. for matching them in data mining scenarios. It is not intended, to produce equally working URLs in all cases. The following steps are performed by this node:
- Lower case URL
- Add http:// protocol, if not present
- Transform https:// to http:// protocol
- Remove session IDs from URLs
- Normalize relative path components (e. g. "..")
- Remove trailing slashes from URLs
- Remove “index.htm*” part from URLs
- Sort query parameters alphabetically
Options
Popular Successors
- String Manipulation6 %
- URL Domain Extractor6 %
- HTTP Retriever6 %
- HTML Parser6 %
- Tika Parser URL Input6 %
- GET Request6 %
HTTP Retriever6 %- String to URI5 %
Row Filter (deprecated)5 %- URL Extractor5 %
- URL Resolver4 %
- POST Request2 %
- Download / Upload from List (legacy)2 %
- URL to File Path2 %
CSV Writer2 %- Normalizer Apply (PMML)2 %
- String Replacer2 %
- Interactive Table (legacy)2 %
- String to JSON2 %
- URL Normalizer2 %
Web Searcher2 %- Form Encoded HTTP Entity Creator2 %
- URL Decode< 1 %
- URL Encode< 1 %
- Extract URI Info< 1 %
- Upload (legacy)< 1 %
Table Row to Variable< 1 %- Table Row to Variable< 1 %
Table Row To Variable Loop Start< 1 %- Read Images< 1 %
File Reader< 1 %- Chunk Loop Start< 1 %
- Concatenate< 1 %
- Duplicate Row Filter< 1 %
- Column Filter< 1 %
- Reference Row Filter< 1 %
- GroupBy< 1 %
- Joiner< 1 %
Column Rename< 1 %- Rule Engine< 1 %
Table to HTML< 1 %- Webpage Retriever< 1 %
- XPath< 1 %
- Web Page Content Extractor< 1 %
Regex Extractor< 1 %Ranking Services< 1 %
Views
- This node has no views
Workflows
- No workflows found
Links
- No links available
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.