Google Cloud Storage Connector

This node connects to Google Cloud Storage. The resulting output port allows downstream nodes to access the Google Cloud Storage data of a project as a file system, e.g. to read or write files and folders, or to perform other file system operations (browse/list files, copy, move, ...).

Please note that for authentication purposes, this node requires the "Google Authentication (API key)" node to be connected to its input port.

Path syntax: Paths for Google Cloud Storage are specified with a UNIX-like syntax, /mybucket/myfolder/myfile. An absolute for Google Cloud Storage consists of:

  1. A leading slash ("/").
  2. Followed by the name of a bucket ("mybucket" in the above example), followed by a slash.
  3. Followed by the name of an object within the bucket ("myfolder/myfile" in the above example).

URI formats: When you apply the Path to URI node to paths coming from this connector, you can create URIs with the following formats:

  1. Signed https:// URLs which contain credentials, that allow to access files for a certain amount of time (see Signed URLs).
  2. gs:// URLs which can be used to access Google Storage with tools like Google's gsutil or in Hadoop environments.

Options

Settings

Project ID
Specifies the project to which the Cloud Storage data belongs. See Google Cloud Documentation for more informations.
Working directory
Specifies the working directory using the path syntax explained above. The working directory must be specified as an absolute path. A working directory allows downstream nodes to access files/folders using relative paths, i.e. paths that do not have a leading slash. If not specified, the default working directory is "/".
Normalize paths
Determines if the path normalization should be applied. Path normalization eliminates redundant components of a path like, e.g. /a/../b/./c" can be normalized to "/b/c". When these redundant components like "../" or "." are part of an existing object, then normalization must be deactivated in order to access them properly.

Advanced

Connection timeout in seconds
Timeout in seconds to establish a connection or 0 for an infinite timeout.
Read timeout in seconds
Timeout in seconds to read data from an established connection or 0 for an infinite timeout.

Input Ports

Icon
The Google Service Connection that carries authentication credentials. Please note that currently only the "Google Authentication (API key)" node can be connected to this port.

Output Ports

Icon
Google Cloud Storage File System Connection

Views

This node has no views

Workflows

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.