When I should use JIT op building and when should I use pre-compile op building

[delock]

Hi, I'm looking at options of building deepspeed in my environment. There are two ways to build DeepSpeed, the first way is pre-compiled op kernels with OpBuilder. In this mode DeepSpeeds OpBuilder will be used to build accelerator kernels during deepspeed installation time. The second way is JIT mode, in this mode DeepSpeed acceleraor kernels will be built when the op is used for the first time.

I noticed that JIT is the default way of installation DeepSpeed. I want to understand what is the benefit I will get by using JIT, and in what situation should use pre-compiled instead. Is there a simple explaination under which circumstance each option should be used? Thanks!