[BUG] #7709
Description
When there are tensors registered with register buffer in the weight file, the weights are only loaded on device 0 when loading weights across multiple devices.
{{ message }}
When there are tensors registered with register buffer in the weight file, the weights are only loaded on device 0 when loading weights across multiple devices.