Databricks Asset Bundles for Spark Connect Rust

Get started with the template by cloning this repo and running the following command

databricks bundle init PATH_TO_CHECKOUT

Or use this template directly with the following command

databricks bundle init [email protected]:sjrusso8/dab-template-rust-unofficial.git

Background

This template is an example of how to use spark-connect-rs with a databricks asset bundle. This template works for regular job clusters, and serverless job clusters.

Dependencies

1. Databricks CLI

2. Rust and Cargo (duh)

3. uv as the package and project manager

4. maturin to build rust binaries as python packages

Refs

1. Databricks Asset Bundle: default-python
2. dab-template-goland-unofficial