This node allows to perform different HTTP methods: GET, POST, HEAD, PUT, DELETE, PATCH.
The node allows to transfer content, which must be given as binary or string data. It handles cookies and allows to specify arbitrary
HTTP headers.
Results of the “HTTP Retriever” node are provided as “HTTP Result” cell type. The HTTP Result type bundles the actual binary content of the result, status code, and all HTTP response headers. In case you want to extract header information from an HTTP Result, use the “HTTP Result Data Extractor” node.
Form-encoded requests
In case you want to send content with your HTTP requests (typically for POST and PUT), you
can select a Binary cell as input in the HTTP Retriever node’s configuration. For building a form-encoded request,
use the “Form Encoded HTTP Entity Creator” node, where you can transform string columns to encoded key-value data.
Do not forget to specify HTTP entity content type in HTTP Retriever’s configuration afterwards.
Multipart-encoded requests
Multipart-encoded requests can be created using the “Multipart Encoded HTTP Entity Creator” node. It requires one or more binary input columns and creates (1) a combined multipart-encoded column, (2) column with the content type header, including the delimiter. Connect an HTTP Retriever node and select appended binary column as HTTP entity input, and use a flow variable to set the proper HTTP entity content type.
Cookies
Cookies which are created during the node’s execution are output to the HTTP Retriever’s second output port. In case you want to send cookies with a request, use the second (optional) input port of the HTTP Retriever node. When performing sequential requests with multiple HTTP Retriever nodes, you can simply chain the cookie in- and out-ports to hand the cookies through the workflow.
“Infotising”: This node is only intended for “static” HTML structures. If you need to work with interactive web pages and web apps which are dynamically generated client-side in the browser, have a look at our plugin “Selenium Nodes”.
Options
General
Headers
Advanced
Proxy
Popular Successors
- HTML Parser19 %
- HTTP Result Data Extractor8 %
- Form Encoded HTTP Entity Creator2 %
Row Splitter (deprecated)2 %HTTP Retriever2 %- String to JSON2 %
- Loop End2 %
- HTTP Retriever2 %
Loop End1 %- Tika Parser URL Input1 %
Joiner1 %- Feed Parser1 %
- Column Filter< 1 %
Excel Writer (XLS)< 1 %- String to Path< 1 %
- Binary Objects to Files< 1 %
- String Manipulation< 1 %
CSV Writer< 1 %- Chunk Loop Start< 1 %
- Interactive Table (legacy)< 1 %
- Parallel Chunk End< 1 %
- XPath< 1 %
- URL Resolver< 1 %
- Current URL< 1 %
Table Row to Variable< 1 %Row Filter (deprecated)< 1 %- XML to PMML< 1 %
- Columns to JSON< 1 %
- JSON to Table< 1 %
- URL Domain Extractor< 1 %
- Binary Objects to Strings< 1 %
- Download / Upload from List (legacy)< 1 %
- Strings to Binary Objects< 1 %
- Wait...< 1 %
- Concatenate< 1 %
- Cell Splitter< 1 %
- String Replacer< 1 %
RSS Feed Reader< 1 %Strings To Document< 1 %- JSON Path< 1 %
- Multipart Encoded HTTP Entity Creator< 1 %
- Breakpoint< 1 %
- Catch Errors (Data Ports)< 1 %
- CSV Writer< 1 %
- Java Snippet< 1 %
Variable Condition Loop End< 1 %- Recursive Loop End< 1 %
Concatenate (Optional in)< 1 %- RowID< 1 %
- Rule-based Row Filter< 1 %
- Rule-based Row Splitter< 1 %
- End IF< 1 %
- Document Viewer< 1 %
- Python Script (legacy)< 1 %
- GET Request< 1 %
- POST Request< 1 %
- Webpage Retriever< 1 %
- Column to XML< 1 %
- String to XML< 1 %
- XSLT< 1 %
- Web Page Content Extractor< 1 %
- Coordinate Parser< 1 %
- URL Extractor< 1 %
- Trim Image Whitespace< 1 %
- HTML Node to Text< 1 %
Recursive Loop End< 1 %- Partitioning< 1 %
- Rule Engine< 1 %
Bag of Words Creator< 1 %- Binary Objects to PNGs< 1 %
- Read Images< 1 %
- TimeDelay Loop End< 1 %
- Column Expressions (legacy)< 1 %
- Generic JavaScript View (JavaScript)< 1 %
Web Searcher< 1 %Click< 1 %- Bulk RemoteWebDriver Factory< 1 %
- Find Elements< 1 %
- Wait< 1 %
- Table to String< 1 %
- Extract URI Info< 1 %
Variable to Table Column< 1 %Table Writer< 1 %- Table Creator< 1 %
- Counting Loop Start< 1 %
Number To String< 1 %- Reference Row Filter< 1 %
- GroupBy< 1 %
- IF Switch< 1 %
- TimeDelay Loop Start< 1 %
- Java Snippet (simple)< 1 %
- Document Data Extractor< 1 %
- Strings to Document< 1 %
- Tags to String< 1 %
- Google Sheets Updater< 1 %
- Table View (JavaScript)< 1 %
- Table Editor (JavaScript)< 1 %
XPath< 1 %Table to HTML String< 1 %- Google Address Geocoder< 1 %
- Feed Discovery< 1 %
Find Elements< 1 %- Highlight< 1 %
Table Extractor< 1 %Wait-for-time< 1 %- Load text-based files< 1 %
- URL Decode< 1 %
- PDB Downloader< 1 %
Binary Objects to Files< 1 %- HTTP Connection (legacy)< 1 %
- String to URI< 1 %
- URL to File Path< 1 %
- Try (Data Ports)< 1 %
Table Column to Variable< 1 %- Table Row to Variable< 1 %
Table Row To Variable Loop Start< 1 %Variable to Table Row< 1 %Image Writer (Table Column)< 1 %Database Writer< 1 %- Table Writer< 1 %
Table Reader< 1 %Counting Loop Start< 1 %Interval Loop Start< 1 %Generic Loop Start< 1 %Recursive Loop End (2 ports)< 1 %- Recursive Loop Start< 1 %
Cell Splitter< 1 %- Column Aggregator< 1 %
Column Appender< 1 %- Missing Value (Apply)< 1 %
- Missing Value< 1 %
- String Splitter (Regex)< 1 %
Column Rename< 1 %- Column Splitter< 1 %
- Table Transposer< 1 %
- Cache< 1 %
Merge Variables< 1 %- Send Email< 1 %
- Timer Info< 1 %
- Parallel Chunk End (multi port)< 1 %
Table to HTML< 1 %Table to PDF< 1 %- Generic Web Service Client< 1 %
XLS Writer< 1 %Excel Writer (XLS)< 1 %- Java Edit Variable (simple)< 1 %
- Java Snippet Row Filter< 1 %
- String Matcher< 1 %
- RegEx Filter< 1 %
- Snowball Stemmer< 1 %
- RSS Feed Reader< 1 %
Document Data Extractor< 1 %- Tagged Document Viewer< 1 %
- JSON Row Combiner< 1 %
- XML to JSON< 1 %
- JSON Path (Dictionary)< 1 %
- Container Output (JSON)< 1 %
- JSON to XML< 1 %
Python Script (1⇒1)< 1 %- Python Edit Variable (legacy)< 1 %
- R Snippet< 1 %
- PUT Request< 1 %
- Table Difference Checker< 1 %
- Fail in execution< 1 %
- Time Generator (legacy)< 1 %
- Country Extractor< 1 %
XML Reader< 1 %XML Writer< 1 %Regex Extractor< 1 %Hash Calculator< 1 %- AP Calculator< 1 %
FreeGeoIP< 1 %OAuth< 1 %Extract Attribute< 1 %Extract CSS Property< 1 %Extract Outer/InnerHTML< 1 %Execute JavaScript< 1 %- Take Screenshot< 1 %
Views
- This node has no views
Workflows
03_Parsing_the_KNIME_ForumKNIME Hub- 04_Model_Deployment_dashboard_WebPortalKNIME Hub
- 04_Model_Deployment_dashboard_WebPortalKNIME Hub
- 04_Parsing_the_KNIME_ForumKNIME Hub
- 06_NY_Times_RSS_Feed_Tag_CloudKNIME Hub
- Show all 106 workflows
Links
- GET fails if the response does not have Content-Type setby armingrudd on 2019-07-31forum.knime.com/p/66923
- cURL in POST or GET Nodeby qqilihq on 2020-01-29forum.knime.com/p/80169
- web scrapingby danielesser on 2019-03-21forum.knime.com/p/57051
- Get request only get header with status code and mime typeby qqilihq on 2020-03-26forum.knime.com/p/85537
- Increase date by loopingby armingrudd on 2019-11-27forum.knime.com/p/75620
- Show all 53 links
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.