Skip to main content

Populate databricks cluster ID in state database

Prerequisites​

  1. Access to the associated statedb
  2. Access to the databricks workspace

Steps​

  1. First navigate to the cluster 'Data-Engineering-Interactive' in the databricks workspace. Then click on the JSON tab in the far right. switch.PNG

  2. Scroll all the way to the bottom of the cluster definition and grab the cluster ID. JSON.PNG

  3. Then, login to the sql database through your preferred method and change the identifier value in the state_config.DatabricksClusterLookup table. Table.PNG