Skip to content

Conversation

ax3l
Copy link
Member

@ax3l ax3l commented Feb 17, 2022

Start to fix MR reads on higher levels, where we have declared but undefined regions and need to filter by valid boxes.

Old Implementation

Full read included UB regions that should not be read (standard: openPMD/openPMD-standard#252).
After multiple reads, this could look like this:
Screenshot from 2022-02-17 12-24-04

New Implementation

Mask invalid regions to zero, read only valid regions:
Screenshot from 2022-02-17 12-23-56

@ax3l ax3l added the bug label Feb 17, 2022
@ax3l ax3l force-pushed the fix-mr-undefinedRegions branch 2 times, most recently from c62fe8c to f6b52ed Compare February 17, 2022 20:57
Start to fix MR reads on higher levels, where we have declared
but undefined regions and need to filter by valid boxes.
@ax3l ax3l force-pushed the fix-mr-undefinedRegions branch from f6b52ed to b8b5a48 Compare February 17, 2022 20:57
@ax3l ax3l changed the title [Draft] Fix MR Reads Fix MR Reads Feb 17, 2022
@ax3l ax3l changed the title Fix MR Reads Fix MR Reads (ADIOS) Feb 17, 2022
@ax3l ax3l requested a review from RemiLehe February 17, 2022 22:56
@ax3l ax3l marked this pull request as ready for review February 17, 2022 23:16
@ax3l ax3l force-pushed the fix-mr-undefinedRegions branch 2 times, most recently from a6993a9 to bd62e71 Compare February 17, 2022 23:20
install_requires=install_requires,
extras_require = {
'all': ["ipympl", "ipywidgets", "matplotlib", "numba", "openpmd-api", "wget"],
'all': ["ipympl", "ipywidgets", "matplotlib", "numba", "openpmd-api~=0.14.0", "wget"],
Copy link
Member Author

@ax3l ax3l Feb 17, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With 0.14.0+, available_chunks/availableChunks became mature enough to be used in all use cases:
https://github.com/openPMD/openPMD-api/blob/0.14.4/CHANGELOG.rst

@ax3l ax3l force-pushed the fix-mr-undefinedRegions branch 6 times, most recently from f20dcbd to 9703458 Compare February 18, 2022 02:27
@ax3l
Copy link
Member Author

ax3l commented Feb 18, 2022

cc @tmsclark and @lucafedeli88 for review :)

@ax3l ax3l force-pushed the fix-mr-undefinedRegions branch from 9703458 to e2217e2 Compare February 18, 2022 02:36
@RemiLehe RemiLehe merged commit 99271a5 into openPMD:dev Feb 24, 2022
@ax3l ax3l deleted the fix-mr-undefinedRegions branch March 4, 2022 03:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants