Databricks Unity File System Connector

Connects to the Unity Volumes of a Databricks workspace, in order to read/write files in downstreamnodes.

The resulting output port allows downstream nodes to access Databricks Unity Volumes as a file system, e.g. to read or write files and folders, or to perform other file system operations (browse/list files, copy, move, ...).

Path syntax: Paths for this connector are specified with a UNIX-like syntax, for example /example-catalog/example-schema/example-volume/myfolder/file.csv, which is an absolute path that consists of:

  1. a leading slash (/)
  2. the name of a catalog in the workspace (example-catalog)
  3. the name of a schema in the catalog (example-schema)
  4. the name of a volume in the schema (example-volume)
  5. The name of a folder or file in the volume (myfolder/file.csv)

Options

Working directory
Specifies the working directory using the path syntax explained above. The working directory must be specified as an absolute path. A working directory allows downstream nodes to access files/folders using relative paths, i.e. paths that do not have a leading slash. If not specified, the default working directory is "/".

Input Ports

Icon
Databricks Workspace connection

Output Ports

Icon
Databricks Unity File System.

Popular Predecessors

  • No recommendations found

Popular Successors

  • No recommendations found

Views

This node has no views

Workflows

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.