Skip to content

phdf5 output is ... slo0ooo0oowwwwWww #16

@gnwong

Description

@gnwong

I've opted for the questionably severe "bug" label given how much this behavior impacts runtime.

In particular, it seems like the default way hdf5 writes files from a large (~256) number of nodes on stampede2 is far slower than it should be. Presumably, this problem scales with the number of nodes, and this is particularly concerning when trying to run large simulations (e.g., 448x224x224) in a reasonable amount of wall time.

In addition to optimizing the mpi write on stampede2, it seems like writing smaller dump files (not outputting gamma or diagnostics like extras/fixup, extras/divB, extras/fail) should speed things up as well.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions