Icon

01_​Amazon_​S3_​Remote_​File_​Example

Amazon S3 Remote File Example
This workflow demonstrates how to use the S3 Connection. It demonstrates bucket creation, folder creation, file upload, file download, filelisting, and file deletion. It also shows how to use the S3 File Picker, for reading files directly without downloading them first. Connection to S3 serviceCreation of a bucket and a directory where a file is uploaded. Download of the previous uploaded file.The file can be aso be read from an URL Delete our example bucket from S3 Stream reading of the fle without beingdownloaded to the local machine. Create a bucketwith a unique nameConvert the flow variableto URI to delete bucketCreate directoryinside the created bucketList the all files/foldersin the created examplebucketrecursivelyUpload iris.csvto the createdexampledirectory insidethe examplebucketList data folder(includes adult.data)Convert URL (String)column to URIDownloadadult.dataRead the downloadedcsv from diskRead the csv directlyfrom S3Delete the bucketUsing the pathwe create a url fromwhich the csv readercan read directlySpecify your credentials Create Directory Table Creator Create UniqueBucket Name Create Directory List Remote Files Upload List Files String to URI Download Extract folder URIas flow variable CSV Reader Extract file URIas flow variable Extract csv path ons3 as flow variable CSV Reader Delete Files Amazon S3File Picker Stream it in InteractiveTable (local) Merge Variables Amazon S3Connection This workflow demonstrates how to use the S3 Connection. It demonstrates bucket creation, folder creation, file upload, file download, filelisting, and file deletion. It also shows how to use the S3 File Picker, for reading files directly without downloading them first. Connection to S3 serviceCreation of a bucket and a directory where a file is uploaded. Download of the previous uploaded file.The file can be aso be read from an URL Delete our example bucket from S3 Stream reading of the fle without beingdownloaded to the local machine. Create a bucketwith a unique nameConvert the flow variableto URI to delete bucketCreate directoryinside the created bucketList the all files/foldersin the created examplebucketrecursivelyUpload iris.csvto the createdexampledirectory insidethe examplebucketList data folder(includes adult.data)Convert URL (String)column to URIDownloadadult.dataRead the downloadedcsv from diskRead the csv directlyfrom S3Delete the bucketUsing the pathwe create a url fromwhich the csv readercan read directlySpecify your credentialsCreate Directory Table Creator Create UniqueBucket Name Create Directory List Remote Files Upload List Files String to URI Download Extract folder URIas flow variable CSV Reader Extract file URIas flow variable Extract csv path ons3 as flow variable CSV Reader Delete Files Amazon S3File Picker Stream it in InteractiveTable (local) Merge Variables Amazon S3Connection

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: oole
Created at: 2016-08-26
On NodePit since: 2019-07-12
Last update: 2024-04-16
Created with KNIME version: v4.1.1
Tags: Amazon S3CloudremotestreamingURL

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!