[QUESTION] Why is it necessary to use fp16 mode when optimizing with enable_optimizer_post_validation

[liqing9399]

   if args.enable_optimizer_post_validation:
        assert args.fp16, "zero bubble post validation"

[QPHutu]

I guess most people use FP16 for LLM training, so we only implement our code in MixedPrecisionOptimizer.