Skip to content

Commit 33a3dda

Browse files
committed
refactor: drop backward-compatible shims for the Dataproc -> Managed Spark rename
Removes the google.cloud.dataproc_spark_connect / google.cloud.dataproc_magics shim packages, the DataprocSparkSession/DataprocMagics aliases, the sessionTemplate() deprecated alias for runtimeProfile(), and the DATAPROC_SPARK_CONNECT_* env var fallback. Anyone moving to the new google-cloud-managed-spark-connect package needs to update their imports, builder calls, and env vars directly rather than relying on a deprecation period.
1 parent 0d005ab commit 33a3dda

14 files changed

Lines changed: 26 additions & 414 deletions

File tree

README.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -170,7 +170,14 @@ pip install google-cloud-managed-spark-connect
170170

171171
## Migrating from dataproc-spark-connect
172172

173-
The `dataproc-spark-connect` package and the `google.cloud.dataproc_spark_connect` module have been renamed to `google-cloud-managed-spark-connect` / `google.cloud.managed_spark_connect`, and `DataprocSparkSession` has been renamed to `ManagedSparkSession`. The old import path and class name still work but emit a `DeprecationWarning` — update your imports when convenient:
173+
The `dataproc-spark-connect` package has been renamed to `google-cloud-managed-spark-connect`. This is a breaking change — update your code when you switch to the new package:
174+
175+
* `pip install dataproc-spark-connect``pip install google-cloud-managed-spark-connect`
176+
* `google.cloud.dataproc_spark_connect``google.cloud.managed_spark_connect`
177+
* `DataprocSparkSession``ManagedSparkSession`
178+
* `DataprocMagics` / `google.cloud.dataproc_magics``ManagedSparkMagics` / `google.cloud.managed_spark_magics`
179+
* `.sessionTemplate(...)` builder method → `.runtimeProfile(...)`
180+
* `DATAPROC_SPARK_CONNECT_*` environment variables → `MANAGED_SPARK_CONNECT_*`
174181

175182
```python
176183
# Before

google/cloud/dataproc_magics/__init__.py

Lines changed: 0 additions & 28 deletions
This file was deleted.

google/cloud/dataproc_magics/magics.py

Lines changed: 0 additions & 18 deletions
This file was deleted.

google/cloud/dataproc_spark_connect/__init__.py

Lines changed: 0 additions & 27 deletions
This file was deleted.

google/cloud/dataproc_spark_connect/client/__init__.py

Lines changed: 0 additions & 16 deletions
This file was deleted.

google/cloud/dataproc_spark_connect/client/core.py

Lines changed: 0 additions & 21 deletions
This file was deleted.

google/cloud/dataproc_spark_connect/client/proxy.py

Lines changed: 0 additions & 13 deletions
This file was deleted.

google/cloud/dataproc_spark_connect/environment.py

Lines changed: 0 additions & 16 deletions
This file was deleted.

google/cloud/dataproc_spark_connect/exceptions.py

Lines changed: 0 additions & 20 deletions
This file was deleted.

google/cloud/dataproc_spark_connect/pypi_artifacts.py

Lines changed: 0 additions & 3 deletions
This file was deleted.

0 commit comments

Comments
 (0)