Skip to content

Commit 81c2f5e

Browse files
authored
docs: better instruction for spark_connect and sql_warehouse mode in databricks catalog cookbook (#165)
1 parent c204b16 commit 81c2f5e

1 file changed

Lines changed: 28 additions & 0 deletions

File tree

catalogs/databricks/README.md

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -175,6 +175,8 @@ Create a Databricks service principal by following the [Databricks documentation
175175

176176
Update spicepod by replacing `databricks_token` with the `databricks_client_id` and `databricks_client_secret` from the Databricks service principal.
177177

178+
### mode: delta_lake
179+
178180
```yaml
179181
params:
180182
mode: delta_lake
@@ -187,6 +189,32 @@ params:
187189
databricks_aws_endpoint: <endpoint> # If using an S3-compatible service, like Minio
188190
```
189191

192+
### mode: spark_connect
193+
194+
Pre-requisite: Configure `can attach to` permission for service principal in `Compute` > `Clusters` > `your-test-cluster` > `Permissions`
195+
196+
```yaml
197+
params:
198+
mode: spark_connect
199+
databricks_endpoint: <instance-id>.cloud.databricks.com
200+
databricks_client_id: ${env:DATABRICKS_CLIENT_ID}
201+
databricks_client_secret: ${env:DATABRICKS_CLIENT_SECRET}
202+
databricks_cluster_id: ${env:DATABRICKS_CLUSTER_ID}
203+
```
204+
205+
### mode: sql_warehouse
206+
207+
Pre-requisite: Configure `can use` permission for service principal in `SQL Warehouses` > `your-test-sql-warehouse` > `Permissions`
208+
209+
```yaml
210+
params:
211+
mode: sql_warehouse
212+
databricks_endpoint: <instance-id>.cloud.databricks.com
213+
databricks_client_id: ${env:DATABRICKS_CLIENT_ID}
214+
databricks_client_secret: ${env:DATABRICKS_CLIENT_SECRET}
215+
databricks_sql_warehouse_id: ${env:DATABRICKS_SQL_WAREHOUSE_ID}
216+
```
217+
190218
## Step 9. Restart the Spice runtime
191219

192220
```bash

0 commit comments

Comments
 (0)