Mostly due to containers/podman#4495.

The current implementation assumes it's possible to mount the containers file system locally, which is not possible for remote podman instances.