Task: Implement on-demand data download

[tamsinrogers]

Description

Ideally want to be able to fetch the static contents of neuromaps-nhp-prep and download on the fly as needed. A directory to download the data to will have to be specified (either user-provided or a chosen location).

Tasks

• Check API for OSF vs Zenodo (without login) for pulling data
• Move data to a host location (OSF, Zenodo, etc.)
• Update YAML file with uri
• Add method for downloading data
• Cache data to DATA_DIR so that it only needs to be downloaded if the file isn't found at the expected file path.
• Update test instructions (real data section)

Freeform Notes

• OSF

  • API documentation
  • 5GB limit for private repositories / 50GB limit for public repositories.

• Zenodo

  • API documentation
  • 50GB limit per dataset

• Regardless of host location, potentially want multiple "projects" for the data that isn't already hosted elsewhere (maybe split by species?)