You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Since CI Docker commands will use the same filesystem, as they have the same Docker socket, you need to configure the working directory of your runners accordingly.
34
-
35
-
## Speeding up our Actions Runner Image
36
-
37
-
After we were able to run the actions runner image in as Slurm job using [sbatch](https://slurm.schedmd.com/sbatch.html) and [custom script](https://github.com/WATonomous/run-gha-on-slurm/blob/main/allocate-ephemeral-runner-from-docker.sh) we ran into the issue of having to pull the docker image for every job. From the time the script allocated resources to the time the job began was ~ 2 minutes. When you are running 70+ jobs in a workflow, with some jobs depending on others, this time adds up fast.
38
-
39
-
Unfortunately, caching the image is not an elegant solution because this would require mounting the filesystem directory to the Slurm job. This means we would need to have multiple directories if we wanted to support multiple concurrent runners. This would require creating a system to manage these directories and would introduce the potenital for starvation and dead locks.
40
-
41
-
This led us to investegate a [Docker pull through cache](https://docs.docker.com/docker-hub/mirror/).
0 commit comments