Open
Description
We now have two concourse workers, however they waste infinite time attempting to stream build step artifacts back and forth between them.
Concourse seems to assume workers all exist in the same network... which is definitely not the case for us 👎
Here's a screenshot of it wasting over 20 minutes copying the git artifacts from the first node to the second node...
concourse/concourse#8861 suggests we have to target pipelines to tags on specific workers 😞 That essentially means we have the following options:
- Rigidly assign pipelines and resources to individual nodes (removing the fault tolerance ability)
- Play with placement strategies.. (though, the default should be our "ideal") https://concourse-ci.org/container-placement.html#fewest-build-containers-strategy
- Figure out a way for artifact streaming to be quick between geographically diverse nodes.
Metadata
Metadata
Assignees
Labels
No labels
Activity