Migrate cmip6 metadata to esgf-ng

[jpnavarro]

Publish cmpi6 metadata to esgf-ng, and once that metadata is verified to be correct and available to ng uses, delete it from esgf-1.5

[sashakames]

We discussed this in the ESGF-XC call.

• We will need to publish the Items and (primary) assets for the sites that did their original publications.
• We will wait and register replicas for other Items (those originating elsewhere)

Some suggestions on how to approach this:

• Use a scroll query to crawl through "Dataset" records. These will become the items
• Crawl through "File" records to register assets.
• esgcet module (esg-publisher) has STAC ingest code. Generate the record and can be published via a CLI

[sashakames]

Institution_id list for what original records are in scope:

DOE:
UCI (78689)
E3SM-Project (17846)
UCSB (6214)
RUBISCO (438)
LLNL (324)

North America: CCCma, NCAR, NOAA-GFDL, NASA-GISS, UA
Japan: MIROC, MRI
China: BCC, CAS, NUIST, THU
S.Korea: SNU, NIMS-KMA, KIOST

Other: INM (PMIP only)