Error invalid device ordinal at line 359 in file /opt/bitsandbytes/csrc/pythonInterface.c

[shahizat]

Hello,

During the finetuning of LLM on the NVIDIA Jetson AGX Orin Developer Kit, I have encountered an issue. When I use the parameter settings paged_adamw_8bit or paged_adamw_32bit, the process fails with the error message: "invalid device ordinal at line 359 in file /opt/bitsandbytes/csrc/pythonInterface.c". However, when I use adamw_8bit or adamw_32bit, the process works without any issues. Do you know how to solve this problem?

Thanks in advance for your help!

Best regards,
Shakhizat