Resize, Dask, openpmd-pipe and new ADIOS2 Iteration Encoding

This release adds support for resizable data sets. For data-processing, support for Dask (parallel) and Pandas (serial) are added and lazy reader parsing of iterations is now supported. ADIOS2 adds an experimental variable-based iteration encoding. An openPMD Series can now be flushed from non-Series objects and write buffers can be requested upfront to avoid unnecessary data copies in some situations.

Thanks to Axel Huebl, Franz Poeschel, Erik Schnetter, Junmin Gu, John Kirkham, and Dmitry Ganyushin for contributing to this release!

Fix AppleClang & DPC++ Build

Fix a missing include that fails builds with Apple's clang and Intel's dpcpp compilers.

Thanks to Axel Huebl for contributing to this release!

Fix Various Read Issues

This release fixes various bugs related to reading: a chunk fallback for constant components, skip missing patch records, a backend bug in each ADIOS2 & HDF5, and we made the Python load_chunk method more robust.

Thanks to Axel Huebl and Franz Poeschel for contributing to this release!

Fix Patch Read & Python store_chunk

This release fixes a regression with particle patches, related to Iteration::open() and ::close() functionality. Also, issues with the Python store_chunk method are addressed.

Thanks to Axel Huebl and Franz Poeschel for contributing to this release!

Fix openPMD-ls & Iteration open/close

This release fixes regressions in the series "ls" functionality and tools, related to Iteration::open() and ::close() functionality. We also add support to read back complex numbers with JSON.

Thanks to Franz Poeschel and Axel Huebl for contributing to this release!

Streaming Support, Python, Benchmarks

This release adds first support for streaming I/O via ADIOS2's SST engine. More I/O benchmarks have been added with realistic application load patterns. Many Python properties for openPMD attributes have been modernized, with slight breaking changes in Iteration and Mesh data order. This release requires C++14 and adds support for Python 3.9. With this release, we leave the "alpha" phase of the software and declare "beta" status.

Thanks to Axel Huebl, Franz Poeschel, Junmin Gu, Richard Pausch, and Sergei Bastrakov for contributing to this release!

Complex Numbers, Close & Backend Options

This release adds data type support for complex numbers, allows to close iterations and adds first support for backend configuration options (via JSON), which are currently implemented for ADIOS2. Further installation options have been added (homebrew and CLI tool support with pip). New free standing functions and macro defines are provided for version checks.

Thanks to Axel Huebl, Franz Poeschel, and Lígia Diana Amorim for contributing to this release!

HDF5-1.12, Azimuthal Examples & Tagfile

This release adds support for the latest HDF5 release. Also, we add versioned Doxygen and a tagfile for external docs to our online manual.

Thanks to Axel Huebl for contributing to this release!

Robust Independent I/O

This release improves MPI-parallel I/O with HDF5 and ADIOS. ADIOS2 is now the default backend for handing .bp files.

Thanks to Axel Huebl, Junmin Gu and Ligia Diana Amorim for contributing to this release!

Improved HDF5 Handling

More robust HDF5 file handling and fixes of local includes for more isolated builds.

Thanks to Axel Huebl, Junmin Gu, Ligia Diana Amorim, Richard Pausch, and Igor Andriyash for contributing to this release!