Make sure docker image builds on ARM

[surovic]

Yeah, I don't expect any cross-architecture build are necessary. Just making it possible to build on both x86 and arm64 would be good. I also don't think this has to happen immediately, we can get an arm build working when needed.

Originally posted by @josephsweeney in #6517 (comment)