[fix] fix writer in training & engram allreduce mode (#1200) #3

Job	Run time
run_tests / checkout_and_config	10s
run_tests / cli_validation / functional_test_cli	1d 0h 0m 0s
run_tests / unit_tests	0s
run_tests / functional_tests_serve	0s
run_tests / functional_tests_train	0s
run_tests / all_tests_complete	2s
run_tests / functional_tests_hetero_train	0s
run_tests / functional_tests_inference	0s
run_tests / functional_tests_benchmark	0s
all_tests	3s
	1d 0h 0m 15s

Provide feedback