Skip to content

Dask for template histogram construction #401

Open
@alexander-held

Description

@alexander-held

With dask-awkward and integration with hist, it seems conceptually possible to make the template histogram creation fully Dask-driven. This could result in two significant improvements:

  • parallelization of template histogram construction,
  • optimization of data processing, e.g. avoiding duplicate data reading when filling lots of histograms that only differ by a weight.

The latter requires dask-awkward and dask-histogram and needs to build the full task graph before calling compute. This is a much bigger change than providing an interface that allows distribution of template construction (which acts as a black box function) via e.g. Dask.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions