0 ×

01_​Amazon_​S3_​Remote_​File_​Example

Workflow

Amazon S3 Remote File Example
Amazon S3CloudremotestreamingURL
This workflow demonstrates how to use the S3 Connection. It demonstrates bucket creation, folder creation, file upload, file download, filelisting, and file deletion. It also shows how to use the S3 File Picker, for reading files directly without downloading them first. Connection to S3 serviceCreation of a bucket and a directory where a file is uploaded. Download of the previous uploaded file.The file can be aso be read from an URL Delete our example bucket from S3 Stream reading of the fle without beingdownloaded to the local machine. Create a bucketwith a unique nameConvert the flow variableto URI to delete bucketCreate directoryinside the created bucketList the all files/foldersin the created examplebucketrecursivelyUpload iris.csvto the createdexampledirectory insidethe examplebucketList data folder(includes adult.data)Convert URL (String)column to URIDownloadadult.dataRead the downloadedcsv from diskRead the csv directlyfrom S3Delete the bucketUsing the pathwe create a url fromwhich the csv readercan read directlySpecify your credentials Create Directory Table Creator Create UniqueBucket Name Create Directory List Remote Files Upload List Files String to URI Download Extract folder URIas flow variable CSV Reader Extract file URIas flow variable Extract csv path ons3 as flow variable CSV Reader Delete Files Amazon S3File Picker Stream it in InteractiveTable (local) Merge Variables Amazon S3Connection This workflow demonstrates how to use the S3 Connection. It demonstrates bucket creation, folder creation, file upload, file download, filelisting, and file deletion. It also shows how to use the S3 File Picker, for reading files directly without downloading them first. Connection to S3 serviceCreation of a bucket and a directory where a file is uploaded. Download of the previous uploaded file.The file can be aso be read from an URL Delete our example bucket from S3 Stream reading of the fle without beingdownloaded to the local machine. Create a bucketwith a unique nameConvert the flow variableto URI to delete bucketCreate directoryinside the created bucketList the all files/foldersin the created examplebucketrecursivelyUpload iris.csvto the createdexampledirectory insidethe examplebucketList data folder(includes adult.data)Convert URL (String)column to URIDownloadadult.dataRead the downloadedcsv from diskRead the csv directlyfrom S3Delete the bucketUsing the pathwe create a url fromwhich the csv readercan read directlySpecify your credentialsCreate Directory Table Creator Create UniqueBucket Name Create Directory List Remote Files Upload List Files String to URI Download Extract folder URIas flow variable CSV Reader Extract file URIas flow variable Extract csv path ons3 as flow variable CSV Reader Delete Files Amazon S3File Picker Stream it in InteractiveTable (local) Merge Variables Amazon S3Connection

Download

Get this workflow from the following link: Download

Nodes

01_​Amazon_​S3_​Remote_​File_​Example consists of the following 36 nodes(s):

Plugins

01_​Amazon_​S3_​Remote_​File_​Example contains nodes provided by the following 4 plugin(s):