For anyone who runs into this error:
The Docker base image v2.1.0 to v2.3.0 (latest) is built on ubuntu:22.04, which has a known issue: libmapnik is compiled without proj support in ubuntu 22.04.
Solution:
Use v2.0.1 or earlier, which are based on ubuntu:20.04 and do not have this problem.