Google BigQuery Connector

This node creates a connection to a Google BigQuery server via its JDBC driver. Due to license restrictions the BigQuery JDBC driver is not part of the KNIME Analytics Platform and needs to be downloaded and registered separately. For more details on where to download and how to register the BigQuery driver see the database documentation.
You need to provide the server's hostname (or IP address), the port, and a database name (project ID). Login credentials are provided via the Google Service Connection input port.

If the optional Google Service Connection port is used, the node authenticates via a pre-generated access token (OAuthType=2). By default, this method works only with a Google Service Account. To use interactive OAuth, you must setup your own OAuth consent screen and OAuth client ID.

In addition the node supports Application Default Credentials (OAuthType=3) as well as Google Service Account (OAuthType=0) based authentication. These methods can be configured using appropriate JDBC connection parameters. For detailed setup instructions, refer to the Install and configuration guide of the BigQuery JDBC driver.

Note: The node does not allow to pass in any pre-generated access tokens directly via configuration (OAuthType=2), as this is handled exclusively through the credential port. Google user account authentication (OAuthType=1) is not supported for security reasons.

This node uses the selected driver's JDBC URL template to create the concrete database URL. Field validation in the dialog depends on whether the (included) tokens referencing them are mandatory or optional in the template.

Options

Database dialect
Choose the registered database dialect here.
Use latest driver version available
If selected, upon execution the node will automatically use the driver with the latest (highest) driver version that is available for the current database type. This has the advantage that you do not need to touch the workflow after a driver update. However, the workflow might break in the rare case that the behavior of the driver e.g. type mapping changes with the newer version.
Database driver
Choose the JDBC driver to connect to the database here. You can select a specific version of the registered drivers via the drop-down list. Additional drivers can be registered via KNIME's preference page "KNIME -> Databases".
Hostname
The hostname (or IP address) of a Google BigQuery server. The corresponding driver URL template variable is host.
Port
The port on which the Google BigQuery server is listening. The default port is 443. The corresponding driver URL template variable is port.
Database name
The name of the database you want to connect to. The corresponding driver URL template variable is database.
JDBC parameters
This section allows you to define JDBC driver connection parameters. The value of a parameter can be a constant, credential username, credential password, file path, or KNIME URL. For more information about the supported driver properties see the Simba BigQuery JDBC driver documentation.
Input mapping by name
Columns that match the given name (or regular expression) and database type will be mapped to the specified KNIME type.
  • Column selection type: The option allows you to select how the column is matched.
    • Manual: Use the exact name of the column
    • Regex: Allow regex expressions to select multiple columns
  • Column name: The name or regex expression.
  • Database type: SQL type to map from.
  • Mapping to: Datatype to map to.
Input mapping by type
Columns that match the given database type will be mapped to the specified KNIME type.
  • From type: SQL type to map from.
  • To type: Datatype to map to.
Output mapping by name
Columns that match the given name (or regular expression) and KNIME type will be mapped to the specified database type.
  • Column selection type: The option allows you to select how the column is matched.
    • Manual: Use the exact name of the column
    • Regex: Allow regex expressions to select multiple columns
  • Column name: The name or regex expression.
  • Source type: Datatype to map from.
  • Mapping to: SQL type to map to.
Output mapping by type
Columns that match the given KNIME type will be mapped to the specified database type.
  • From type: Datatype to map from.
  • To type: SQL type to map to.
Additional settings
This tab allows you to define KNIME framework properties such as connection handling, advanced SQL dialect settings or logging options. The available properties depend on the selected database type and driver. For more information about the supported parameters see the KNIME Database Extension Guide.

Input Ports

Icon
When connected, the node authenticates via the access token provided by the connected Google Authenticator node (OAuthType=2).

Output Ports

Icon
Google BigQuery DB Connection.

Popular Predecessors

  • No recommendations found

Popular Successors

  • No recommendations found

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.