Skip to content

bench: fix hardcoded per-dataset provenance metadata in loader.py #126

Description

@davorrunje

Context

benchmarks/datasets/loader.py:104 hardcodes metadata={"source": "zenodo:7968969", "license": "CC-BY-4.0"} for every dataset the loader returns. This mislabels datasets whose true provenance differs (e.g. adult is a UCI dataset, not that Zenodo record). It is currently inert — DatasetBundle.metadata is not consumed anywhere — but the field is wrong and would mislead anyone who starts using it.

Goal

Set correct per-dataset provenance metadata, or remove the misleading hardcoded value.

Where

  • benchmarks/datasets/loader.py:104 (the hardcoded metadata=...).
  • benchmarks/datasets/registry.py — where per-dataset info could be sourced.
  • benchmarks/_common/bundle.pyDatasetBundle.metadata definition.

Acceptance criteria

  • metadata["source"] reflects each dataset's true origin (per-dataset), or the hardcoded field is removed.
  • No dataset is labeled with a provenance that isn't its own.

References

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingfollow-upDeferred work captured as a self-contained issue

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions