[dagster-cloud-cli] Fix uv deployment: detect pip/uv for local package builds

Problem
-------
In uv-managed virtualenvs (uv venv --no-pip), pip is absent from the
interpreter. The PEX builder's _build_local_package hard-coded
python -m pip install for pyproject.toml packages, causing these
deployments to fail with a missing pip error.

Changes
-------
- Add package_manager.py with PackageManager (@record) and
  detect_package_manager(): probe pip first, fall back to uv, raise a
  clear error if neither is available
- Detect package manager once per build (not per package) to avoid
  repeated 15-second subprocess probes on multi-package deploys
- Store the shutil.which-resolved interpreter path in PackageManager so
  uv's --python flag always receives an absolute path, regardless of
  caller cwd
- Align the upfront pyproject.toml scan with per-directory routing:
  exclude dirs that have a co-located setup.py (setup.py always wins in
  _build_local_package), removing the detection/routing inconsistency
- Fix docker_utils.py shell injection: replace shell=True + f-string
  composition with subprocess.run(..., input=password.encode())
- Add unit tests (TestDetectPackageManager, TestPackageManagerCommands,
  TestBuildPexUsingSetupPy) and integration tests for real pip/uv envs

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

Author: vidiyala99

.buildkite/buildkite-shared/buildkite_shared/context.py

@@ -164,7 +164,11 @@ def get_package(self, name: str) -> "PythonPackage":
         norm_name = name.replace("_", "-")
         if norm_name not in self._packages:
             all_packages_str = "\n".join([pkg.name for pkg in sorted(self._packages.values())])
-            raise Exception(f"Could not find {name} in package list. Packages:\n{all_packages_str}")
+            raise Exception(
+                f"Could not find {name} in package list. Packages are discovered via"
+                " `git ls-files '**/tox.ini'` — ensure the package has a tox.ini file committed"
+                f"and tracked by git.\nPackages:\n{all_packages_str}"
+            )
         return self._packages[norm_name]
 
     def has_package(self, name: str) -> bool:
@@ -267,8 +271,15 @@ def has_component_integration_changes(self) -> bool:
             for path in self.changed_files
         )
 
-    def has_dg_or_component_integration_changes(self) -> bool:
-        return self.has_dg_changes() or self.has_component_integration_changes()
+    def has_rest_resources_changes(self) -> bool:
+        return any("dagster-rest-resources" in str(path) for path in self.changed_files)
+
+    def has_dg_or_component_integration_or_rest_resource_changes(self) -> bool:
+        return (
+            self.has_dg_changes()
+            or self.has_component_integration_changes()
+            or self.has_rest_resources_changes()
+        )
 
     def has_storage_test_fixture_changes(self) -> bool:
         return any(

.buildkite/dagster-buildkite/dagster_buildkite/steps/packages.py

@@ -826,12 +826,11 @@ def _library_packages_with_custom_config(ctx: BuildkiteContext) -> list[PackageS
         PackageSpec(
             oss_path("python_modules/libraries/dagster-dg-cli"),
             pytest_tox_factors=[
-                ToxFactor("general", splits=3),
-                ToxFactor("docs"),
+                ToxFactor("general"),
                 ToxFactor("plus"),
             ],
             env_vars=["SHELL"],
-            force_run_fn=BuildkiteContext.has_dg_or_component_integration_changes,
+            force_run_fn=BuildkiteContext.has_dg_or_component_integration_or_rest_resource_changes,
             # general tests depend on dagster-dbt which does not support Python 3.14
             unsupported_python_versions=(
                 lambda tox_factor: (
@@ -1000,6 +999,13 @@ def _library_packages_with_custom_config(ctx: BuildkiteContext) -> list[PackageS
             ],
             force_run_fn=BuildkiteContext.has_storage_test_fixture_changes,
         ),
+        PackageSpec(
+            oss_path("python_modules/libraries/dagster-rest-resources"),
+            pytest_tox_factors=[
+                ToxFactor("default"),
+            ],
+            force_run_fn=BuildkiteContext.has_rest_resources_changes,
+        ),
         PackageSpec(
             oss_path("python_modules/libraries/dagster-twilio"),
             env_vars=["TWILIO_TEST_ACCOUNT_SID", "TWILIO_TEST_AUTH_TOKEN"],

.claude/python_packages.md

@@ -111,13 +111,14 @@ Quick reference for Python packages in the Dagster repository.
 
 ## utilities
 
-**dagster-shared**: `python_modules/libraries/dagster-shared`
-**dagster-ssh**: `python_modules/libraries/dagster-ssh`
-**dagster-github**: `python_modules/libraries/dagster-github`
-**dagster-datahub**: `python_modules/libraries/dagster-datahub`
 **dagster-census**: `python_modules/libraries/dagster-census`
+**dagster-datahub**: `python_modules/libraries/dagster-datahub`
+**dagster-github**: `python_modules/libraries/dagster-github`
 **dagster-hightouch**: `python_modules/libraries/dagster-hightouch`
 **dagster-managed-elements**: `python_modules/libraries/dagster-managed-elements`
+**dagster-rest-resources**: `python_modules/libraries/dagster-rest-resources`
+**dagster-shared**: `python_modules/libraries/dagster-shared`
+**dagster-ssh**: `python_modules/libraries/dagster-ssh`
 
 ## cli tools
 
@@ -137,5 +138,5 @@ Quick reference for Python packages in the Dagster repository.
 All paths are relative to the repository root and follow these patterns:
 
 - Core: `python_modules/{package-name}`
-- Libraries: `python_modules/libraries/{package-name}`
+- Libraries: `dagster-oss/python_modules/libraries/{package-name}`
 - Testing: Most packages have `{package-name}_tests/` subdirectories

.github/workflows/build-docs.yml

@@ -56,7 +56,7 @@ jobs:
           fi
 
       - name: Checkout repository
-        uses: actions/checkout@v4
+        uses: actions/checkout@v6
         with:
           fetch-depth: ${{ env.FETCH_DEPTH }}
 

.github/workflows/build-integration-registry.yml

@@ -23,7 +23,7 @@ jobs:
     runs-on: ubuntu-latest
     steps:
       - name: Checkout repository
-        uses: actions/checkout@v4
+        uses: actions/checkout@v6
         with:
           fetch-depth: 1
 

.github/workflows/check-docs.yml

@@ -12,7 +12,7 @@ jobs:
   check-frontmatter:
     runs-on: ubuntu-latest
     steps:
-    - uses: actions/checkout@v4
+    - uses: actions/checkout@v6
 
     - name: Install uv
       uses: astral-sh/setup-uv@v5

.github/workflows/update-dagster-ui-yarn-lock.yml

@@ -13,7 +13,7 @@ jobs:
       contents: write
       pull-requests: write
     steps:
-      - uses: actions/checkout@v4
+      - uses: actions/checkout@v6
 
       - name: Enable Corepack
         run: corepack enable

CHANGES.md

@@ -1,5 +1,61 @@
 # Changelog
 
+## 1.13.0 (core) / 0.29.0 (libraries)
+
+### Major Changes Since 1.12.0
+
+- **AI-assisted development**: Released [dagster-io/skills](https://github.com/dagster-io/skills), a collection of Dagster-focused AI skills for coding agents like Claude Code, OpenAI Codex, and others. Expanded `dg api` commands for programmatic inspection of assets, runs, jobs, schedules, and more.
+- **Partitioned asset checks**: Asset checks can now target specific partitions of an upstream asset, aligning data quality logic with how partitioned data is produced and monitored.
+- **State-backed components enabled by default**: Integrations that depend on external metadata (dbt, Fivetran, Airbyte, Tableau, Looker, etc.) now use persisted local state by default, providing a more predictable code location loading experience.
+- **Virtual assets (preview)**: New `is_virtual` parameter on `@asset` and `AssetSpec` for modeling assets like database views that automatically reflect upstream changes without explicit materialization.
+- **20+ new components**: Added or expanded components for dbt Cloud, Spark, Azure (Blob Storage, ADLS2), GCP (BigQuery, GCS, Dataproc), Databricks, Tableau, Looker, Census, Polytomic, and more. Integrations gained richer observability, metadata, and operational support.
+- **Deeper integration support**: dbt Cloud supports partitioned assets; Databricks gained job-level subsetting and auto-cancel on run termination; Fivetran added polling sensors, retry-on-reschedule, and resync support; BI integrations auto-enrich assets with table metadata for cross-system lineage.
+- **Dagster+ improvements**: Organization-level timezone settings, service users for Pro accounts, more resilient code server redeploy behavior, improved agent failure recovery, and expanded insights and alerting workflows.
+
+### Breaking Changes
+
+- Removed deprecated `external_asset_from_spec` and `external_assets_from_specs`. Use `AssetSpec` inputs directly to `Definitions(...)` or `AssetsDefinition(specs=[...])` instead.
+- Removed deprecated single-`AssetKey` `deps` argument support from asset dependencies. Use a sequence of `AssetDep` objects instead.
+- Removed deprecated `get_all_asset_specs` from `Definitions`.
+- Removed deprecated `legacy_freshness_policy` parameter from `@observable_source_asset`.
+- Removed deprecated `auto_observe_interval_minutes` parameter from `@observable_source_asset`.
+- Removed deprecated `legacy_freshness_policies_by_output_name` parameter from `AssetsDefinition`.
+- Removed deprecated `load_component_at_path` from `ComponentLoadContext`. Use `context.load_component` instead.
+- Removed deprecated `build_defs_at_path` from `ComponentLoadContext`.
+- [dagster-airbyte] Removed deprecated `AirbyteState` enum (use `AirbyteJobStatusType` instead) and removed deprecated `legacy_freshness_policy` and `auto_materialize_policy` parameters from `build_airbyte_assets()`.
+- [dagster-looker] Removed deprecated `DagsterLookerResource.build_defs`, `get_asset_key`, `get_dashboard_asset_key`, `get_explore_asset_key`, `get_view_asset_key` methods, and `Type[DagsterLookerApiTranslator]` support from API helpers.
+- [dagster-powerbi] Removed deprecated `PowerBIWorkspace.build_defs()`, translator key helpers (use `get_asset_spec()` instead), and `Type[DagsterPowerBITranslator]` support in `load_powerbi_asset_specs()` (pass an instance instead).
+- [dagster-sigma] Removed deprecated `SigmaOrganization.build_defs()`, `DagsterSigmaTranslator.get_asset_key()` (use `get_asset_spec(...).key` instead), and `Type[DagsterSigmaTranslator]` support in `load_sigma_asset_specs()` (pass an instance instead).
+
+### New
+
+- (Preview) Added support for virtual assets. The `@asset` decorator and `AssetSpec` now accept an `is_virtual` parameter for defining assets that represent views or derived tables that don't need to be materialized. Virtual assets are supported in staleness calculations, execution planning, and declarative automation.
+- Job-level config defaults are now applied when partial config is provided to a run.
+- [dagster-dbt] Added `enable_dbt_views_as_virtual_assets` setting to `DbtTranslatorSettings` for automatically treating dbt views as virtual assets.
+
+### Bugfixes
+
+- Fixed an issue where a sensor targeting a job with `run_tags` and specifying an `asset_selection` in the `RunRequest` would not apply the job's `run_tags` to the resulting run.
+- Fixed a potential error in YAML config snapshot conversion when encountering `None` fields.
+- [dg] Fixed `dg plus deploy configure` generating a GitHub Action that used Docker instead of the PEX build strategy.
+- [dagster-cloud-cli] PR comments in CI are now scoped by deployment name, preventing overwrites across deployments.
+- [ui] Fixed "Missing" partition selection for time-based partitioned assets.
+- [ui] Fixed raw log display rendering after `ansi-to-react` library update.
+- [ui] "Terminate all runs" dialog now handles extremely large sets of runs more reliably.
+
+### Documentation
+
+- Added Dagster+ agent configuration page for serverless and hybrid deployments.
+- Added data portability documentation page.
+- Reorganized run isolation documentation for hybrid and serverless deployments.
+- Added ELT pipeline example with dlt and Sling.
+
+### Dagster Plus
+
+- Added SCIM Groups filter support for `members.value eq` queries.
+- Fixed an issue where the Dagster+ Kubernetes agent would emit log noise about `DAGSTER_CLOUD_RAW_GIT_URL` and `DAGSTER_CLOUD_GIT_URL` environment variables when `onlyAllowUserDefinedK8sConfigFields` was set.
+- Fixed incorrect alert type label for metrics alerts.
+
 ## 1.12.22 (core) / 0.28.22 (libraries)
 
 ### New

docs/docs/api/api-lifecycle/.gitignore

@@ -0,0 +1,2 @@
+**/*.mdx
+!index.md

docs/docs/api/api-lifecycle/filtering-api-lifecycle-warnings.md

@@ -1,6 +1,6 @@
 ---
 description: Filter Dagster API lifecycle warnings using the Python warnings module.
-sidebar_position: 200
+sidebar_position: 100
 title: Filtering API lifecycle warnings
 ---