Skip to content

Update Spark compatibility and installation guidance - #763

Open
jkasireddy wants to merge 1 commit into
awslabs:masterfrom
jkasireddy:master
Open

Update Spark compatibility and installation guidance#763
jkasireddy wants to merge 1 commit into
awslabs:masterfrom
jkasireddy:master

Conversation

@jkasireddy

Copy link
Copy Markdown

Issue #, if available:

N/A — documentation update.

Description of changes:

  • Updated the README to clarify that Deequ 2.x artifacts are built for specific Apache Spark 3.x versions.
  • Added a Spark/Deequ compatibility table covering Spark 3.1.x through Spark 3.5.x.
  • Updated the Maven and SBT dependency examples to use 2.0.21-spark-3.5.
  • Removed ambiguous wording from the existing compatibility guidance.
  • This is a documentation-only change and does not modify application behavior.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found.


Generated by AI (model: us.anthropic.claude-opus-4-8, prompt: 4d2f5d73) — may not be fully accurate. Reply if this doesn't help.
Reviewed by Shadow · github.com/sudsali/shadow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant