Skip to content

Optimize ReadH5#7297

Closed
hen-w wants to merge 1 commit into
sxs-collaboration:developfrom
hen-w:readh5
Closed

Optimize ReadH5#7297
hen-w wants to merge 1 commit into
sxs-collaboration:developfrom
hen-w:readh5

Conversation

@hen-w

@hen-w hen-w commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

Subfiles (.vol, .dat) are always top-level HDF5 groups. Replace h5file.visit() with h5file.keys() to avoid recursively walking every dataset in the file, which is extremely slow on ZFS.

Proposed changes

Upgrade instructions

Code review checklist

  • The code is documented and the documentation renders correctly. Run
    make doc to generate the documentation locally into BUILD_DIR/docs/html.
    Then open index.html.
  • The code follows the stylistic and code quality guidelines listed in the
    code review guide.
  • The PR lists upgrade instructions and is labeled bugfix or
    new feature if appropriate.
  • If a coding agent is used, have one of
    "Co-Authored-By: Claude Sonnet 4.6 noreply@anthropic.com",
    "Co-Authored-by: Codex noreply@openai.com", or
    "Co-Authored-By: GitHub Copilot CLI noreply@microsoft.com"
    as the last line of the commit, depending on the agent.

Further comments

Subfiles (.vol, .dat) are always top-level HDF5 groups. Replace
h5file.visit() with h5file.keys() to avoid recursively walking
every dataset in the file, which is extremely slow on ZFS.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@hen-w hen-w added the small Only changes a few lines of code, does a rename or is otherwise quick to review label Jun 14, 2026
@hen-w

hen-w commented Jun 14, 2026

Copy link
Copy Markdown
Contributor Author

Actually we cannot assume all subfiles are in top-level HDF5 groups. So the best way to avoid wasting time to find the correct subfile is to specify the subfile whenever possible. For example, always specify -d for generate-xdmf.

@hen-w hen-w closed this Jun 14, 2026
@hen-w hen-w deleted the readh5 branch June 14, 2026 19:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

small Only changes a few lines of code, does a rename or is otherwise quick to review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant