Support CUDA 12.9 #1688
Description
Feature request
Hi, bitsandbytes team!
I installed bitsandbytes==4.46.0 in a CUDA 12.9 environment. However, when I tried to import bitsandbytes, I encountered the following error:
bitsandbytes library load error: Configured CUDA binary not found at /usr/local/lib/python3.12/dist-packages/bitsandbytes/libbitsandbytes_cuda129.so
Traceback (most recent call last):
File "/usr/local/lib/python3.12/dist-packages/bitsandbytes/cextension.py", line 290, in <module>
lib = get_native_library()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/bitsandbytes/cextension.py", line 270, in get_native_library
raise RuntimeError(f"Configured CUDA binary not found at {cuda_binary_path}")
RuntimeError: Configured CUDA binary not found at /usr/local/lib/python3.12/dist-packages/bitsandbytes/libbitsandbytes_cuda129.so
Looking at the installation directory (/usr/local/lib/python3.12/dist-packages/bitsandbytes/), I noticed that there is no CUDA 12.9 binary present:
__init__.py _ops.py cextension.py diagnostics libbitsandbytes_cuda118.so libbitsandbytes_cuda122.so libbitsandbytes_cuda125.so nn triton
__main__.py autograd consts.py functional.py libbitsandbytes_cuda120.so libbitsandbytes_cuda123.so libbitsandbytes_cuda126.so optim utils.py
__pycache__ backends cuda_specs.py libbitsandbytes_cpu.so libbitsandbytes_cuda121.so libbitsandbytes_cuda124.so libbitsandbytes_cuda128.so research
Do you have any plans to support CUDA 12.9 in an upcoming release? Can I build bitsandbytes from source by master branch to support CUDA 12.9?
Thanks!
Motivation
Support to newest CUDA version to support sm100 and sm120.
Your contribution
No