please provide python whel package in nvidia jetson agx orin (aarch64 + cuda)

[WangFengtu1996]

Feature request

please provide python whel package in nvidia jetson agx orin (aarch64 + cuda)

Motivation

please provide python whel package in nvidia jetson agx orin (aarch64 + cuda)

Your contribution

please provide python whel package in nvidia jetson agx orin (aarch64 + cuda)

[WangFengtu1996]

version 0.43.1

[KungFuPandaPro]

seems that do not support aarch64

[shubhamgupto]

Hey any updates on this?
Im runing jetson orin nano with CUDA 12.4

currently can install only version 0.42.0 which results in this

python -m bitsandbytes
False

===================================BUG REPORT===================================
/xxxxxxxxxxxxxx/miniconda3/envs/minicpm/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: Welcome to bitsandbytes. For bug reports, please run

python -m bitsandbytes


  warn(msg)
================================================================================
/xxxxxxxxxxxxxx/miniconda3/envs/minicpm/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: /xxxxxxxxxxxxxx/miniconda3/envs/minicpm did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths...
  warn(msg)
/home/rivet01/miniconda3/envs/minicpm/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: /usr/local/cuda-12.4/lib64:/usr/local/cuda-12.4/lib64:/usr/local/cuda-12.4/lib64:/usr/local/cuda-12.4/lib64:/usr/local/cuda-12.4/lib64: did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths...
  warn(msg)
The following directories listed in your path were found to be non-existent: {PosixPath('local/ubuntu'), PosixPath('@/tmp/.ICE-unix/2522,unix/ubuntu')}
The following directories listed in your path were found to be non-existent: {PosixPath('/etc/xdg/xdg-ubuntu')}
The following directories listed in your path were found to be non-existent: {PosixPath('1'), PosixPath('0')}
The following directories listed in your path were found to be non-existent: {PosixPath('/org/gnome/Terminal/screen/5c11be7d_873d_4dd0_87b2_1d2f56aedfc9')}
The following directories listed in your path were found to be non-existent: {PosixPath('path=/run/user/1000/bus,guid=31fede2ecb96f8ad387a6ac90000003a'), PosixPath('unix')}
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
DEBUG: Possible options found for libcudart.so: {PosixPath('/usr/local/cuda/lib64/libcudart.so')}
CUDA SETUP: PyTorch settings found: CUDA_VERSION=124, Highest Compute Capability: 8.7.
CUDA SETUP: To manually override the PyTorch CUDA version please see:https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
CUDA SETUP: Required library version not found: libbitsandbytes_cuda124.so. Maybe you need to compile it from source?
CUDA SETUP: Defaulting to libbitsandbytes_cpu.so...

================================================ERROR=====================================
CUDA SETUP: CUDA detection failed! Possible reasons:
1. You need to manually override the PyTorch CUDA version. Please see: "https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
2. CUDA driver not installed
3. CUDA not installed
4. You have multiple conflicting CUDA libraries
5. Required library not pre-compiled for this bitsandbytes release!
CUDA SETUP: If you compiled from source, try again with `make CUDA_VERSION=DETECTED_CUDA_VERSION` for example, `make CUDA_VERSION=113`.
CUDA SETUP: The CUDA version for the compile might depend on your conda install. Inspect CUDA version via `conda list | grep cuda`.
================================================================================

CUDA SETUP: Something unexpected happened. Please compile from source:
git clone https://github.com/TimDettmers/bitsandbytes.git
cd bitsandbytes
CUDA_VERSION=124
python setup.py install
CUDA SETUP: Setup Failed!