Skip to content

Support notebook-scoped Python packages on Databricks #15715

Description

@sd-db

Problem

dbt-databricks supports notebook_scoped_libraries for Python models, but Fusion does not currently provide equivalent configuration, package installation, or Jobs behavior.

Desired behavior

Fusion should match the behavior introduced by databricks/dbt-databricks#1321:

  • accept the same boolean configuration forms and reject invalid values;
  • prepend notebook-scoped %pip install and Python restart cells;
  • preserve package order and duplicates;
  • avoid installing scoped packages again as job-level libraries; and
  • preserve additional libraries and workflow job settings.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions