Skip to content

Add webhook validation for SparkConnect CRD #2848

@tariq-hasan

Description

@tariq-hasan

What feature you would like to be added?

The Spark Operator currently includes webhook validation for resources such as SparkApplication, but similar validation is not yet implemented for the SparkConnect CRD.

To ensure consistency across Spark-related CRDs and to centralize API validation at the controller level, we should introduce webhook validation for SparkConnect as well.

Why is this needed?

This would:

  • Align SparkConnect behavior with existing Spark CRDs
  • Prevent invalid resource specifications at admission time
  • Allow SDK-side validation logic to be simplified or removed

Describe the solution you would like

No response

Describe alternatives you have considered

No response

Additional context

This was discussed during the development of the SparkClient API in Kubeflow SDK where manual validation was identified as better suited for controller-side enforcement. See kubeflow/sdk#225 (comment).

cc @andreyvelich @ChenYi015 @Shekharrajak

Love this feature?

Give it a 👍 We prioritize the features with most 👍

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions