V2: Metadata issue in finalise?

[ddobie]

Been occasionally seeing this error:

2025-05-29 02:07:02,766 runpipeline ERROR Processing error:
Metadata mismatch found in `from_delayed`.

Partition type: `pandas.core.frame.DataFrame`
+----------+---------+----------+
| Column   | Found   | Expected |
+----------+---------+----------+
| 'source' | float64 | object   |
+----------+---------+----------+
Traceback (most recent call last):
  File "/import/vera1/ddob1600/vast-pipeline-vera-instance/vast-pipeline/vast_pipeline/management/commands/runpipeline.py", line 356, in run_pipe
    pipeline.process_pipeline(p_run)
  File "/import/vera1/ddob1600/vast-pipeline-vera-instance/vast-pipeline/vast_pipeline/pipeline/main.py", line 340, in process_pipeline
    nr_sources, nr_new_sources = final_operations(
                                 ^^^^^^^^^^^^^^^^^
  File "/import/vera1/ddob1600/vast-pipeline-vera-instance/vast-pipeline/vast_pipeline/pipeline/finalise.py", line 133, in final_operations
    srcs_df = srcs_df.compute()
              ^^^^^^^^^^^^^^^^^
  File "/import/ada2/ddob1600/.conda/envs/vast-pipeline-vera-dev/lib/python3.11/site-packages/dask/dataframe/dask_expr/_collection.py", line 489, in compute
    return DaskMethodsMixin.compute(out, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/import/ada2/ddob1600/.conda/envs/vast-pipeline-vera-dev/lib/python3.11/site-packages/dask/base.py", line 374, in compute
    (result,) = compute(self, traverse=False, **kwargs)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/import/ada2/ddob1600/.conda/envs/vast-pipeline-vera-dev/lib/python3.11/site-packages/dask/base.py", line 662, in compute
    results = schedule(dsk, keys, **kwargs)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/import/ada2/ddob1600/.conda/envs/vast-pipeline-vera-dev/lib/python3.11/site-packages/dask/dataframe/utils.py", line 363, in check_meta
    raise ValueError(
      ^^^^^^^^^^^^^^^
ValueError: Metadata mismatch found in `from_delayed`.

Partition type: `pandas.core.frame.DataFrame`
+----------+---------+----------+
| Column   | Found   | Expected |
+----------+---------+----------+
| 'source' | float64 | object   |
+----------+---------+----------+