in 2024.1.1 and forward: VersionMismatchWarning: Mismatched versions found

[BigRedAye]

2024.1.1+ reporting a warning that prevents me from running tasks on workers. Occurs whether I use the images from the repo or if I build it myself.

git clone https://github.com/dask/dask-docker.git
cd dask-docker/build

docker compose build
docker compose up

In the notebook:

from dask.distributed import Client
client = Client()
client.ncores()

Yields:

/opt/conda/lib/python3.10/site-packages/distributed/client.py:1393: VersionMismatchWarning: Mismatched versions found

+---------+-----------------+-----------------+-----------------+
| Package | Client          | Scheduler       | Workers         |
+---------+-----------------+-----------------+-----------------+
| python  | 3.10.14.final.0 | 3.10.12.final.0 | 3.10.12.final.0 |
| toolz   | 0.12.1          | 0.12.0          | 0.12.0          |
+---------+-----------------+-----------------+-----------------+
  warnings.warn(version_module.VersionMismatchWarning(msg[0]["warning"]))

and to do a build myself, I had to edit the docker file and specify a local path for the docker-stacks-foundation. Otherwise I get:

 => ERROR [docker-stacks-foundation internal] load git source github.com/jupyter/docker-stacks.git#main:docker-stacks-foundation 
...
failed to solve: failed to read dockerfile: failed to open subdir docker-stacks-foundation: open /var/lib/docker/overlay2/zgon1olq8ugp5gx5mdhitexts/diff/checkout1643403295/docker-stacks-foundation: no such file or directory

This is happening on Ubuntu 22.04 and when I deploy tasks to AWS Fargate.