Switch from restart file to mesh file in all tasks

[xylar]

E3SM will switch to using ADIOS format for restart files in some configurations. But the MPAS-Ocean and -seaice mesh files from the "mesh" stream should always be safe to use for mesh variables (including those for the 3D MPAS-Ocean mesh).

Checklist

• Developer's Guide has been updated
• Documentation has been built locally and changes look as expected
• Testing comment in the PR documents testing used to verify the changes

Fixes #1107

[milenaveneziani]

Hi @xylar, quick question: would this be backward compatible, ie, if meshStream is undefined in the config file it goes back to using the restart file? Maybe not a good idea in the long run?

[xylar]

Yes, I think that's a reasonable idea. Thanks @milenaveneziani!

[milenaveneziani]

great. Thanks @xylar!

[xylar]

Seeing the following error related to BSF:

  File "/gpfs/fs1/home/ac.xylar/chrysalis/miniforge3/envs/mpas_analysis_dev/lib/python3.13/site-packages/mpas_tools/ocean/streamfunction/barotropic.py", line 106, in compute_barotropic_streamfunction
    bsf_vertex = _compute_barotropic_streamfunction_vertex(
        ds_mesh,
    ...<8 lines>...
        tmp_dir,
    )
  File "/gpfs/fs1/home/ac.xylar/chrysalis/miniforge3/envs/mpas_analysis_dev/lib/python3.13/site-packages/mpas_tools/ocean/streamfunction/barotropic.py", line 440, in _compute_barotropic_streamfunction_vertex
    vert_integ_velocity = compute_vertically_integrated_velocity(
        ds_mesh=ds_mesh,
    ...<7 lines>...
        nedges_chunk=horiz_chunk,
    )
  File "/gpfs/fs1/home/ac.xylar/chrysalis/miniforge3/envs/mpas_analysis_dev/lib/python3.13/site-packages/mpas_tools/ocean/streamfunction/velocity.py", line 110, in compute_vertically_integrated_velocity
    vert_index >= min_level_cell, vert_index <= max_level_cell
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/gpfs/fs1/home/ac.xylar/chrysalis/miniforge3/envs/mpas_analysis_dev/lib/python3.13/site-packages/xarray/core/_typed_ops.py", line 708, in __ge__
    return self._binary_op(other, operator.ge)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/gpfs/fs1/home/ac.xylar/chrysalis/miniforge3/envs/mpas_analysis_dev/lib/python3.13/site-packages/xarray/core/dataarray.py", line 4896, in _binary_op
    f(self.variable, other_variable_or_arraylike)
    ~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/gpfs/fs1/home/ac.xylar/chrysalis/miniforge3/envs/mpas_analysis_dev/lib/python3.13/site-packages/xarray/core/_typed_ops.py", line 1130, in __ge__
    return self._binary_op(other, operator.ge)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/gpfs/fs1/home/ac.xylar/chrysalis/miniforge3/envs/mpas_analysis_dev/lib/python3.13/site-packages/xarray/core/variable.py", line 2438, in _binary_op
    f(self_data, other_data) if not reflexive else f(other_data, self_data)
    ~^^^^^^^^^^^^^^^^^^^^^^^
ValueError: operands could not be broadcast together with shapes (60,) (7268,)

[xylar]

Testing

Okay, after working out a few quirks and bugs, this is working:
https://web.lcrc.anl.gov/public/e3sm/diagnostic_output/ac.xasay-davis/analysis_testing/chrysalis/use-mpaso-mesh-file-not-restart/