Skip to content

Commit 99d746c

Browse files
committed
[SPARK-59939] Deprecate v1beta1 version of SparkApp and SparkCluster CRDs
### What changes were proposed in this pull request? This PR marks the `v1beta1` version of the `SparkApplication` and `SparkCluster` CRDs as deprecated by adding `deprecated: true` to the Helm chart CRDs, and adds an item to `docs/migration_guide.md`. `v1beta1` stays served, and `v1` stays the storage version. ### Why are the changes needed? `v1` is available since [0.5.0](https://github.com/apache/spark-kubernetes-operator/releases/tag/0.5.0) (2025-09-27), but the `v1beta1` schema in the chart is a static snapshot which is no longer updated, e.g. it lacks `spec.suspend`. To remove `v1beta1` in 2.0.0, users need a deprecation period first. ### Does this PR introduce _any_ user-facing change? Yes, compared to the released 1.0.0. `kubectl` prints a deprecation warning for `apiVersion: spark.apache.org/v1beta1`. Existing resources keep working. ### How was this patch tested? Passed `helm lint --strict` and `gradle :spark-operator-api:assertGeneratedCRDMatchesHelmChart`. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Sonnet 5.5 Closes #924 from dongjoon-hyun/SPARK-59939. Authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
1 parent acd3ecd commit 99d746c

3 files changed

Lines changed: 4 additions & 0 deletions

File tree

‎build-tools/helm/spark-kubernetes-operator/crds/sparkapplications.spark.apache.org-v1.yaml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ spec:
2828
scope: Namespaced
2929
versions:
3030
- name: v1beta1
31+
deprecated: true
3132
schema:
3233
openAPIV3Schema:
3334
properties:

‎build-tools/helm/spark-kubernetes-operator/crds/sparkclusters.spark.apache.org-v1.yaml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ spec:
2828
scope: Namespaced
2929
versions:
3030
- name: v1beta1
31+
deprecated: true
3132
schema:
3233
openAPIV3Schema:
3334
properties:

‎docs/migration_guide.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -30,6 +30,8 @@ affect building the project, CI, tests or examples.
3030

3131
### Kubernetes and CRDs
3232

33+
- Since 1.1.0, `spark.apache.org/v1beta1` of the CRDs is deprecated and scheduled for removal in
34+
2.0.0. Its schema is no longer updated, e.g. it lacks `spec.suspend`. Use `spark.apache.org/v1`.
3335
- Since 1.1.0, K8s 1.35 or newer is recommended instead of 1.34 ([SPARK-59692](https://issues.apache.org/jira/browse/SPARK-59692)).
3436
- Since 1.1.0, the CRDs have `spec.suspend` for `SparkApplication` and `SparkCluster`, and the
3537
`Suspended` state for `SparkCluster`. Since `helm upgrade` does not update CRDs, replace them

0 commit comments

Comments
 (0)