Skip to content

Conversation

@bstrdsmkr
Copy link
Collaborator

@bstrdsmkr bstrdsmkr commented Jul 11, 2025

Mainly focused on improvements to the documentation of fields on the query model, but also generally improving the OpenAPI docs at https://esgf-node.ornl.gov/esgf-1-5-bridge/docs and https://esgf-node.ornl.gov/esgf-1-5-bridge/redoc

Initial titles and descriptions are generated through Google Gemini using governing documents pulled from various authoritative sites (PCMDI, WCRP, ESG Search documentation site) and are intended as a starting point. Extra effort has gone into describing how the usage of fields has changed between CMIP phases as fields may no longer be in use, but may still be needed by historical data.

Examples were generated similarly by first looping through each field and issuing a faceted query on that field to retrieve it's values and counts. If a result for a field was empty, the query was retried with type=File under the assumption that the field might only be populated for File records (the default query is for type=Dataset). These results were provided to Gemini as a json file with the following prompt:

Using the cumulative facets data, ensure that all examples in the model make sense. Then, make sure the examples represent good coverage of the possible values for each field

  • Where possible, links to governing documents should be updated to DOI links in case they are ever removed from the source sites
  • Several fields differ only in case or style. Neither Gemini nor I found documentation to prove otherwise so these fields were labeled as alternatives of each other. It is equally possible that only one of the alternatives was ever used, but also that the alternatives we from different MIP eras, or that none we ever used at all. These need to be delineated and updated/removed as appropriate
    • Science Driver vs science driver vs science_driver
      • Of these fields, only science_driver appears populated in our Solr index

      • Only E3SM data appears to have populated the science_driver field and the decision was made not to migrate that data to the Globus Index so that data is now unreachable. Does that imply that we can drop these fields?

        Query results for https://esgf-node.ornl.gov/esg-search/search?format=application%2Fsolr%2Bjson&limit=10&facets=science_driver&query=science_driver:*&type=File
            {
                "responseHeader":{
                  "status":0,
                  "QTime":71,
                  "params":{
                    "facet.field":"science_driver",
                    "df":"text",
                    "q.alt":"*:*",
                    "indent":"true",
                    "echoParams":"all",
                    "fl":"*,score",
                    "start":"0",
                    "fq":"type:File",
                    "sort":"id asc",
                    "rows":"10",
                    "q":"science_driver:*",
                    "shards":"esgf-data-node-solr-query:8983/solr/files",
                    "tie":"0.01",
                    "facet.limit":"-1",
                    "qf":"text",
                    "facet.method":"enum",
                    "facet.mincount":"1",
                    "facet":"true",
                    "wt":"json",
                    "facet.sort":"lex"}},
                "response":{"numFound":2081681,"start":0,"maxScore":1.0,"docs":[
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_01_005601_007601_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_01_005601_007601_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854196,
                      "timestamp":"2021-10-14T01:44:52Z",
                      "checksum":["8cc0901133d8aacfd7f09f30fddf077f3343759acac9bcbc2ee1a8dfd4f5f80b"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_01_005601_007601_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_01_005601_007601_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_01_005601_007601_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_01_005601_007601_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:09.046Z",
                      "_version_":1791757314807562243,
                      "score":1.0},
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_02_005602_007602_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_02_005602_007602_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854196,
                      "timestamp":"2021-10-14T01:47:06Z",
                      "checksum":["591ba8eb175e4d2d16320abc789497310dda71a3b78add39e5e6b566b4e12348"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_02_005602_007602_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_02_005602_007602_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_02_005602_007602_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_02_005602_007602_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:08.828Z",
                      "_version_":1791757314807562244,
                      "score":1.0},
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_03_005603_007603_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_03_005603_007603_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854196,
                      "timestamp":"2021-10-14T01:46:58Z",
                      "checksum":["808f8879432acc81ef0a55bd0b03db0a688cb476e175ecac4eef3f35db309a5f"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_03_005603_007603_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_03_005603_007603_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_03_005603_007603_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_03_005603_007603_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:09.809Z",
                      "_version_":1791757314808610816,
                      "score":1.0},
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_04_005604_007604_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_04_005604_007604_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854196,
                      "timestamp":"2021-10-14T01:46:15Z",
                      "checksum":["547d1a0cc517212e242110f1d9d9a85ef861dc4d0d70c96eccb4099094e388eb"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_04_005604_007604_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_04_005604_007604_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_04_005604_007604_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_04_005604_007604_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:09.879Z",
                      "_version_":1791757314808610817,
                      "score":1.0},
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_05_005605_007605_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_05_005605_007605_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854196,
                      "timestamp":"2021-10-14T01:46:18Z",
                      "checksum":["b1b987e3ca88a27d29ac470d8843ff453bb4409a7a9468094111d68533ca6cc7"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_05_005605_007605_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_05_005605_007605_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_05_005605_007605_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_05_005605_007605_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:09.664Z",
                      "_version_":1791757314808610818,
                      "score":1.0},
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_06_005606_007606_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_06_005606_007606_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854196,
                      "timestamp":"2021-10-14T01:45:59Z",
                      "checksum":["da0215ff4f76f9c01b5cd7577db26def6acc7cbcbdac0c68bbd26b7d58637a59"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_06_005606_007606_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_06_005606_007606_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_06_005606_007606_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_06_005606_007606_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:09.592Z",
                      "_version_":1791757314808610819,
                      "score":1.0},
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_07_005607_007607_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_07_005607_007607_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854196,
                      "timestamp":"2021-10-14T01:46:36Z",
                      "checksum":["ddfa4df582c8d620f178df97b2f0503ecc5c74324ddfe92010150db9a52fa3d7"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_07_005607_007607_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_07_005607_007607_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_07_005607_007607_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_07_005607_007607_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:08.975Z",
                      "_version_":1791757314808610820,
                      "score":1.0},
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_08_005608_007608_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_08_005608_007608_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854196,
                      "timestamp":"2021-10-14T01:47:13Z",
                      "checksum":["8a9019d32d38127470ffcfc12f4564814800c5c63e429c6d90695a5b5452bcbf"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_08_005608_007608_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_08_005608_007608_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_08_005608_007608_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_08_005608_007608_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:09.183Z",
                      "_version_":1791757314809659392,
                      "score":1.0},
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_09_005609_007609_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_09_005609_007609_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854196,
                      "timestamp":"2021-10-14T01:47:05Z",
                      "checksum":["fa5a3d3ac787eacb1e4a5ea79bbc5c3b499f2cc1e0628576b78a2fe37a46d7bd"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_09_005609_007609_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_09_005609_007609_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_09_005609_007609_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_09_005609_007609_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:08.907Z",
                      "_version_":1791757314809659393,
                      "score":1.0},
                    {
                      "source":["E3SM"],
                      "model_version":["1_0"],
                      "experiment":["1950-Control-21yrContHiVol-HR"],
                      "grid_resolution":["0_25deg_atm_18-6km_ocean"],
                      "realm":["atmos"],
                      "regridding":["720x1440"],
                      "data_type":["climo"],
                      "time_frequency":["mon"],
                      "ensemble_member":["ens1"],
                      "data_node":"esgf-node.ornl.gov",
                      "index_node":"esgf-node.ornl.gov",
                      "master_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1",
                      "instance_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1",
                      "id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1.theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_10_005610_007610_climo.nc|esgf-node.ornl.gov",
                      "title":"theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_10_005610_007610_climo.nc",
                      "replica":false,
                      "latest":true,
                      "type":"File",
                      "project":["e3sm"],
                      "version":"1",
                      "dataset_id_template_":["%(source)s.%(model_version)s.%(experiment)s.%(grid_resolution)s.%(realm)s.%(regridding)s.%(data_type)s.%(time_frequency)s.%(ensemble_member)s"],
                      "directory_format_template_":["%(root)s/%(source)s/%(model_version)s/%(experiment)s/%(grid_resolution)s/%(realm)s/%(regridding)s/%(data_type)s/%(time_frequency)s/%(ensemble_member)s/%(version)s"],
                      "variable_id":["Multiple"],
                      "variable":["Multiple"],
                      "north_degrees":89.875,
                      "south_degrees":-89.875,
                      "east_degrees":359.875,
                      "west_degrees":0.125,
                      "campaign":["HighResMIP-v1"],
                      "science_driver":["Water Cycle"],
                      "period":["56 - 76"],
                      "dataset_id":"E3SM.1_0.1950-Control-21yrContHiVol-HR.0_25deg_atm_18-6km_ocean.atmos.720x1440.climo.mon.ens1.v1|esgf-node.ornl.gov",
                      "size":22050854200,
                      "timestamp":"2021-10-14T01:48:02Z",
                      "checksum":["85d8a22da83a372e45604319763b2c3bcd796181311a25a10731bf9d87db3d97"],
                      "checksum_type":["SHA256"],
                      "url":["https://esgf-node.ornl.gov/thredds/fileServer/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_10_005610_007610_climo.nc|application/netcdf|HTTPServer",
                        "https://esgf-node.ornl.gov/thredds/dodsC/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_10_005610_007610_climo.nc.html|application/opendap-html|OPENDAP",
                        "gsiftp://esgf-node.ornl.gov/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_10_005610_007610_climo.nc|application/gridftp|GridFTP",
                        "globus:dea29ae8-bb92-4c63-bdbc-260522c92fe8/user_pub_work/E3SM/1_0/1950-Control-21yrContHiVol-HR/0_25deg_atm_18-6km_ocean/atmos/720x1440/climo/mon/ens1/v1/theta.20190910.branch_noCNT.n438b.unc03.A_WCYCL1950S_CMIP6_HR.ne120_oRRS18v3_ICG_10_005610_007610_climo.nc|Globus|Globus"],
                      "retracted":false,
                      "_timestamp":"2021-10-14T17:43:09.744Z",
                      "_version_":1791757314809659394,
                      "score":1.0}]
                },
                "facet_counts":{
                  "facet_queries":{},
                  "facet_fields":{
                    "science_driver":[
                      "Biogeochemical Cycle",391947,
                      "Cryosphere",72499,
                      "Water Cycle",1617235]},
                  "facet_ranges":{},
                  "facet_intervals":{},
                  "facet_heatmaps":{}}}
    • Period vs period
      • It appears that both capitalizations have been used, though only by E3SM as well
    • ensemble_member vs ensemble_member_
      • ensemble_member_ appears unused
    • campaign vs Campaign
      • Both capitalizations appear to have been used
  • Table 1, Column 1 of CMIP6 Global Attributes, DRS, Filenames, Directory Structure, and CV’s defines quite a few Global Attributes for CMIP6, yet we only have data for the ones in the model. How did we arrive at this subset?

@github-actions
Copy link

github-actions bot commented Jul 11, 2025

Coverage

Coverage Report
FileStmtsMissCoverMissing
src/esg_fastapi
   __init__.py20100% 
   utils.py310100% 
src/esg_fastapi/api
   __init__.py00100% 
   globus.py770100% 
   main.py150100% 
   models.py3510100% 
   routes.py530100% 
   types.py400100% 
src/esg_fastapi/configuration
   __init__.py130100% 
   globus.py80100% 
   logging.py290100% 
   opentelemetry.py200100% 
   profiling.py150100% 
src/esg_fastapi/observability
   __init__.py30100% 
   main.py200100% 
   metrics.py350100% 
   models.py40100% 
   routes.py100100% 
tests
   __init__.py00100% 
   conftest.py150100% 
   test_app.py430100% 
   test_caching.py450100% 
   test_esgsearch_parity.py370100% 
   test_globus_client.py900100% 
   test_metrics.py350100% 
   test_models.py460100% 
   test_observability.py470100% 
   test_settings.py500100% 
   test_utils.py360100% 
TOTAL11700100% 

Tests Skipped Failures Errors Time
84 0 💤 0 ❌ 0 🔥 2.490s ⏱️

Copy link
Member

@nocollier nocollier left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I made some corrections for things that I thought were wrong, but the majority looks pretty good to me and it strikes me is far better than nothing.

title="Activity ID (CMIP6, Obs4MIPs)",
description=(
"Identifies the specific `activity` or MIP associated with the dataset (e.g., `CMIP`, `PMIP`, `DCPP`, `obs4MIPs`). It "
"replaces the broader `activity` field from CMIP5 and can be a space-separated list in CMIP6 <sup>1, 2</sup>.<br><br>"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are we sure it can be a space-separated list in CMIP6? That doesn't sound right to be, each dataset should have only a single activity_id

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Bad News: the CMIP6 Global Attributes, DRS, Filenames, Directory Structure, and CV’s doc, Table 1, note 3 says:

In a few cases it may be appropriate to include multiple activities in the activity_id (separated by single spaces). An example of this is “LUMIP AerChemMIP” for one of the CMIP6 land-use change experiments.

The Good News: neither my File nor Dataset searches turned up anything in the index with a such an entry, so it looks like that specification was never used. ...That or we messed up the ingest to the Globus Index...

description="The `science driver` for the experiment, e.g., `aerosol`.",
openapi_examples={"aerosol": {"summary": "Aerosol", "description": "Aerosol science driver.", "value": "aerosol"}},
)
science_driver_: OptionalParam[MultiValued[str]] = Query(None, alias="science driver", title="Science Driver (Alternative)")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should set more aliases? Can they be a list and include Science_Driver? We could handle others above in the same way.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As near as I can tell from searching the Solr index, it looks like only science_driver was actually used, or at least that's the only one I can get facets back from.

That said, it's hard to know whether the other two were truly unused, or maybe we just never mirrored any files that used those fields?

To complicate things, it looks like only E3SM data used that field and the decision was made not to move that data into the Globus Index, so now that data is unreachable. Does that imply that we should drop these fields?

Copy link
Member

@nocollier nocollier left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added some comments to things that I saw that were outright wrong or misleading. Reading through these makes me put my head in my hands a bit at the mess that some of this is, but my opinion is we should approve it as it is certainly 'better than nothing'.

@nocollier
Copy link
Member

In case my comment was misleading, the mess I was referring to was the state of these facets... capitalized or not and/or with underscores. I also find it hard that there are many with similar names but you can't use them in certain projects (experiment in CMIP5 but experiment_id in CMIP6). This proliferates a large degree of confusion for what I judge is no benefit. I think this PR is a huge step in the right direction.

@bstrdsmkr
Copy link
Collaborator Author

Updated the description with a few notes and more questions

@bstrdsmkr bstrdsmkr force-pushed the field-documentation branch from faf20e0 to 4d95cea Compare July 24, 2025 19:26
Zach Price and others added 2 commits July 24, 2025 15:41
Bumps [fastapi](https://github.com/fastapi/fastapi) from 0.115.14 to 0.116.1.
- [Release notes](https://github.com/fastapi/fastapi/releases)
- [Commits](fastapi/fastapi@0.115.14...0.116.1)

---
updated-dependencies:
- dependency-name: fastapi
  dependency-version: 0.116.1
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
@bstrdsmkr bstrdsmkr force-pushed the field-documentation branch from 4d95cea to 5ca8ba1 Compare July 24, 2025 19:43
@bstrdsmkr bstrdsmkr force-pushed the field-documentation branch from 5ca8ba1 to 75c95b3 Compare July 24, 2025 19:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants