Databricks SQL
This section covers the integration with Databricks SQL.
The Databricks SQL
Database config is the way Ardent gains the ability to work with data in your Databricks SQL environment. It is designed to take in basic auth credentials and use that to automatically understand the data within your catalogs and databases so you can perform operations on it.
Usage
To use the Databricks SQL integration with Ardent, you need to provide the necessary configuration details. Here's an example of how to set up the Databricks SQL config:
-
Find the Configs Section: Go to the configs section in the app
-
Add a Config: Click Add New Config
- Select Config: Select the Databricks SQL config
- Enter Values and Save Config: Configs will not save until you hit "save". Enter the necessary information for your config and hit Save
- Server Hostname: Your Databricks workspace URL
- HTTP Path: The HTTP path to your SQL warehouse
- Access Token: Your Databricks personal access token
- Catalogs: Add any catalogs you want to work with
- For each catalog, you can add multiple databases
- For each database, you can specify tables
Connection Details
The Databricks SQL config requires:
- Server Hostname: The workspace URL from your Databricks instance
- HTTP Path: The HTTP path to your SQL warehouse (found in warehouse connection details)
- Access Token: A personal access token with SQL warehouse access permissions
- Catalogs: The specific catalogs and databases you want to work with
You can add multiple catalogs to a single configuration by using the "Add Catalog" button, and within each catalog, you can add multiple databases using the "Add DB" button.
Note on Connection Configurations
Databricks SQL requires:
- A running SQL warehouse in your Databricks workspace
- Proper access permissions for the token being used
- Valid catalog and database names that exist in your workspace
For more information about Databricks SQL warehouses and access, please refer to the Databricks documentation.