Skip to content

Initial changes for different snapshot behaviours in distRDF #18422

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

Aditya-138-12
Copy link
Contributor

This Pull request:

Allows different snapshot behaviours in dist RDF

Changes or fixes:

  1. Made 3 new functions within the class, _get_base_filename, _merge_snapshot_files, _cleanup_partial_files
  2. added a default option for merging the files -> MERGE_OUTPUT

Checklist:

  • tested changes locally
  • updated the docs (if necessary)

This PR fixes #17136

1. Made 3 new functions within the class, `_get_base_filename`, `_merge_snapshot_files`, `_cleanup_partial_files`
2. added a default option for merging the files -> `MERGE_OUTPUT`
@Aditya-138-12 Aditya-138-12 marked this pull request as draft April 16, 2025 13:29
Copy link

Test Results

    17 files      17 suites   4d 0h 36m 17s ⏱️
 2 739 tests  2 737 ✅ 0 💤  2 ❌
45 169 runs  45 137 ✅ 0 💤 32 ❌

For more details on these failures, see this check.

Results for commit 4da07ce.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Allow different Snapshot behaviours in distributed RDataFrame
2 participants