This page describes how to configure Databricks credentials for use by Census and why those permissions are needed.
Configuring a new Databricks connection
Census supports Databricks LTS versions: 7.3, 9.1, and 10.4
1. Visit the Connections section on Census, and press Add Data Warehouse Connection, selecting Databricks from the list.
2. Enter the hostname, port, and HTTP Path for your cluster. These can be found in the Databricks UI under Clusters → [Your Cluster] → Advanced Options __ → __ JDBC/ODBC. The Databricks documentation covers this in more detail.
3. Enter your Databricks Access Token. A token can be generated in the
👤→ User Settings page in the Databricks UI.
4. Add the following configuration parameters to your cluster. This can be done under Clusters → [Your Cluster] → Advanced Options→Spark.
5. If the CENSUS schema has not been created, please create it by running the following:
CREATE SCHEMA IF NOT EXISTS CENSUS;
6. After the connection is saved, go ahead and press the Test button. This will validate that you've completed the above steps correctly. Once you've got a checkmark for all four steps, you're good to go!