RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cpu!

[RDXiaoLu]

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cpu! (when checking argument for argument
index in method wrapper__index_select)

TorchVision: 0.14.1+cu117
OpenCV: 4.11.0
MMCV: 1.6.2
MMCV Compiler: GCC 9.4
MMCV CUDA Compiler: 11.8
MMDetection: 2.28.2
MMSegmentation: 0.30.0
MMDetection3D: 1.0.0rc6+7175f0d
spconv2.0: False

why? RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cpu!

my run command : tools/dist_train.sh projects/configs/OmniDrive/mask_eva_lane_det_vlm.py 6 --work-dir work_dirs/mask_eva_lane_det_vlm/

[Amireux52]

@exiawsh

[Amireux52]

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cpu! (when checking argument for argument index in method wrapper__index_select)

TorchVision: 0.14.1+cu117 OpenCV: 4.11.0 MMCV: 1.6.2 MMCV Compiler: GCC 9.4 MMCV CUDA Compiler: 11.8 MMDetection: 2.28.2 MMSegmentation: 0.30.0 MMDetection3D: 1.0.0rc6+7175f0d spconv2.0: False

why? RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cpu!

my run command : tools/dist_train.sh projects/configs/OmniDrive/mask_eva_lane_det_vlm.py 6 --work-dir work_dirs/mask_eva_lane_det_vlm/

请问您解决了吗

[Amireux52]

@exiawsh 您好，可以解答一下吗，已经困扰好几天了

[PinTang1999]

same error too.