Server crash #43
Description
Hello,
I am running the WML Pipeline on a Server with 16 cpus and 62.7G RAM. I chose this server because it is the only server with a GPU that I have access to. I got the warning: tensorflow/core/framework/allocator.cc:124] Allocation of 675840000 exceeds 10% of system memory pretty quickly and even tough the analysis continued, it shut my server down within a few minutes.
I then tried running it on a second server with 55 cpsu and 756G RAM, but without a GPU. Here, the processing shut down immediately after starting docker. Is there a way to run this pipeline without a GPU, maybe with an -e flag in docker?
Do you have any suggestions on how to solve this issue?
Thanks a lot!