About multi-node code synchronization #4700
Description
Hello, I’d like to ask: when running in a multi-node setup, does the code under the verl directory need to be fully synchronized across all nodes?
{{ message }}
Hello, I’d like to ask: when running in a multi-node setup, does the code under the verl directory need to be fully synchronized across all nodes?