Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 7 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,13 +8,13 @@ requiring additional steps.
## Install

```sh
pip install google-cloud-managed-spark-connect
pip install google-cloud-spark-connect
```

## Uninstall

```sh
pip uninstall google-cloud-managed-spark-connect
pip uninstall google-cloud-spark-connect
```

## Setup
Expand All @@ -39,7 +39,7 @@ in your code using the builder API:
1. Install the latest version of Managed Spark Connect:

```sh
pip install -U google-cloud-managed-spark-connect
pip install -U google-cloud-spark-connect
```

2. Add the required imports into your PySpark application or notebook and start
Expand Down Expand Up @@ -127,7 +127,7 @@ The package supports the [sparksql-magic](https://github.com/cryeo/sparksql-magi

**Installation**: To use magic commands, install the required dependencies manually:
```bash
pip install google-cloud-managed-spark-connect
pip install google-cloud-spark-connect
pip install IPython sparksql-magic
```

Expand Down Expand Up @@ -165,12 +165,12 @@ See [sparksql-magic](https://github.com/cryeo/sparksql-magic) for more examples.

**Note**: Magic commands are optional. If you only need basic ManagedSparkSession functionality without Jupyter magic support, install only the base package:
```bash
pip install google-cloud-managed-spark-connect
pip install google-cloud-spark-connect
```

## Migrating from dataproc-spark-connect

The `dataproc-spark-connect` package has been renamed to `google-cloud-managed-spark-connect`. This is a breaking change with no compatibility shims — you need to update your code in the following places when you switch to the new package.
The `dataproc-spark-connect` package has been renamed to `google-cloud-spark-connect`. This is a breaking change with no compatibility shims — you need to update your code in the following places when you switch to the new package.

### 1. Update the package you install

Expand All @@ -179,7 +179,7 @@ The `dataproc-spark-connect` package has been renamed to `google-cloud-managed-s
pip install dataproc-spark-connect

# After
pip install google-cloud-managed-spark-connect
pip install google-cloud-spark-connect
```

### 2. Update your imports and session class
Expand Down
2 changes: 1 addition & 1 deletion google/cloud/managed_spark_connect/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
from .session import ManagedSparkSession

old_package_names = ["google-spark-connect", "dataproc-spark-connect"]
current_package_name = "google-cloud-managed-spark-connect"
current_package_name = "google-cloud-spark-connect"
for old_package_name in old_package_names:
try:
importlib.metadata.distribution(old_package_name)
Expand Down
4 changes: 2 additions & 2 deletions setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -19,8 +19,8 @@


setup(
name="google-cloud-managed-spark-connect",
version="1.1.0",
name="google-cloud-spark-connect",
version="1.0.0",
description="Managed Spark client library for Spark Connect",
long_description=long_description,
long_description_content_type="text/markdown",
Expand Down
Loading