Avoid races in system_tests changing config by making the changes atomic

Avoid races in system_tests changing config by making the changes atomic #13055