Skip to content

Conversation

@cosmicBboy
Copy link
Collaborator

This PR unpins the pyspark version dependency in the pyproject.toml. Updates type parasing the pyspark type engine, adds exception handling in the unit tests that have to do with reading csv files in pyspark 4+ in Java 17+

Signed-off-by: cosmicBboy <[email protected]>
Signed-off-by: cosmicBboy <[email protected]>
@codecov
Copy link

codecov bot commented Dec 25, 2025

Codecov Report

❌ Patch coverage is 0% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 83.86%. Comparing base (9e8085a) to head (3b7e13f).
⚠️ Report is 1 commits behind head on main.

Files with missing lines Patch % Lines
pandera/accessors/pyspark_sql_accessor.py 0.00% 5 Missing ⚠️
pandera/engines/pyspark_engine.py 0.00% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2193      +/-   ##
==========================================
- Coverage   83.90%   83.86%   -0.04%     
==========================================
  Files         137      137              
  Lines       10603    10607       +4     
==========================================
  Hits         8896     8896              
- Misses       1707     1711       +4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Signed-off-by: cosmicBboy <[email protected]>
Signed-off-by: cosmicBboy <[email protected]>
@cosmicBboy cosmicBboy merged commit 71255eb into main Dec 25, 2025
222 of 224 checks passed
@cosmicBboy cosmicBboy deleted the enh/spark4 branch December 26, 2025 03:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants