Skip to content

retrieve.rst

Latest commit

 

History

History
180 lines (105 loc) · 5 KB

retrieve.rst

File metadata and controls

180 lines (105 loc) · 5 KB
Raw

Retrieving Data

Not all data dependencies are shipped with the git repository, since git is not suited for handling large changing files. Instead we provide separate data bundles which can be obtained using the retrieve* rules.

Rule retrieve_databundle

.. automodule:: retrieve_databundle

Rule retrieve_tyndp_bundle

.. automodule:: retrieve_tyndp_bundle

Rule retrieve_eurostat_data

.. automodule:: retrieve_eurostat_data

Rule retrieve_jrc_idees

.. automodule:: retrieve_jrc_idees

Rule retrieve_eurostat_household_data

.. automodule:: retrieve_eurostat_household_data

Rule retrieve_co2stop

.. automodule:: retrieve_co2stop

Rule retrieve_gas_infrastructure_data

.. automodule:: retrieve_gas_infrastructure_data

Rule retrieve_osm_data

.. automodule:: retrieve_osm_data

Rule retrieve_bidding_zones

.. automodule:: retrieve_bidding_zones

Rule retrieve_cutout

Cutouts are spatio-temporal subsets of the European weather data from the ECMWF ERA5 reanalysis dataset and the CMSAF SARAH-3 solar surface radiation dataset for the year 2013, 2019 or 2023. They have been prepared by and are for use with the atlite tool. You can either generate them yourself using the build_cutouts rule or retrieve them directly from zenodo through the rule retrieve_cutout. The :ref:`tutorial` uses a smaller cutout than required for the full model (30 MB), which is also automatically downloaded.

Note

To download cutouts yourself from the ECMWF ERA5 you need to set up the CDS API.

Relevant Settings

tutorial:
enable:
    build_cutout:
.. seealso::
    Documentation of the configuration file ``config/config.yaml`` at
    :ref:`toplevel_cf`

Outputs

  • cutouts/{cutout}: weather data from either the ERA5 reanalysis weather dataset and/or SARAH-3 satellite-based historic weather data.
.. seealso::
    For details see :mod:`build_cutout` and read the `atlite documentation <https://atlite.readthedocs.io>`__.

Rule retrieve_electricity_demand

This rule downloads hourly electric load data for each country from the OPSD platform.

Relevant Settings

None.

Outputs

  • data/electricity_demand_raw.csv

Rule retrieve_tyndp_bundle

.. automodule:: retrieve_tyndp_bundle

Rule retrieve_cost_data

This rule downloads techno-economic assumptions from the technology-data repository.

Relevant Settings

enable:
    retrieve_cost_data:

costs:
    year:
    version:
.. seealso::
    Documentation of the configuration file ``config/config.yaml`` at
    :ref:`costs_cf`

Outputs

  • resources/costs.csv

Rule retrieve_ship_raster

This rule downloads data on global shipping traffic density from the World Bank Data Catalogue.

Relevant Settings

None.

Outputs

  • data/shipdensity_global.zip

Rule retrieve_countries_centroids

This rule downloads country centroid geometry data by Copyright (c) 2021 Gavin Rehkemper from https://cdn.jsdelivr.net/gh/gavinr/world-countries-centroids@v1.0.0/dist/countries.geojson.

Relevant Settings

None.

Outputs

  • data/countries_centroids.geojson

Rule retrieve_tyndp_pecd_data

.. automodule:: retrieve_additional_tyndp_data

Rule retrieve_tyndp_hydro_inflows

.. automodule:: retrieve_additional_tyndp_data