-
Notifications
You must be signed in to change notification settings - Fork 676
Issues: bitsandbytes-foundation/bitsandbytes
FSDP2 integration: torch.chunks(Params4bit) not returning Par...
#1424
opened Nov 21, 2024 by
mreso
Open
1
[RFC] PyTorch Custom Operators & Multi-Backend Support
#1545
opened Feb 27, 2025 by
matthewdouglas
Open
2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[RFC] PyTorch Custom Operators & Multi-Backend Support
cross-platform
high priority
(first issues that will be worked on)
RFC
request for comments on proposed library improvements
PyTorch Custom Operator Integration
cross-platform
high priority
(first issues that will be worked on)
ARM runners (faster than cross compilation qemu)
build
cross-platform
Linux
#1539
opened Feb 25, 2025 by
johnnynunez
Loading…
No access to rocminfo in a production environment - ability to manually set GPU arch.
contributions-welcome
We welcome contributions to fix this issue!
cross-platform
Low Risk
Risk of bugs in transformers and other libraries
medium priority
(will be worked on after all high priority issues)
ROCm
#1444
opened Dec 11, 2024 by
isaranto
aarch64 whl in PyPi
aarch64
build
cicd
cross-platform
enhancement
New feature or request
medium priority
(will be worked on after all high priority issues)
Support running on CPU
cross-platform
duplicate
This issue or pull request already exists
enhancement
New feature or request
high priority
(first issues that will be worked on)
x64 CPU
4bit quantized model.dequantize() fails on CPU
cross-platform
duplicate
This issue or pull request already exists
proposing to close
x64 CPU
#1311
opened Aug 7, 2024 by
npbool
ROCm and 8-bit quantization
cross-platform
dependencies
documentation
Improvements or additions to documentation
ROCm
Request for AdamW8bit support on CPU (would help TorchTune)
cross-platform
Intel Integration
Optimizers
Issues or feature requests relating to optimizers
x64 CPU
#1226
opened May 28, 2024 by
sanchitintel
Error invalid device ordinal at line 359 in file /opt/bitsandbytes/csrc/pythonInterface.c
aarch64
cross-platform
Optimizers
Issues or feature requests relating to optimizers
#1225
opened May 28, 2024 by
shahizat
(WIP) Multi backend refactor -> main (full diff of all already merged PRs)
cross-platform
#1220
opened May 25, 2024 by
Titus-von-Koeller
Loading…
please provide python whel package in nvidia jetson agx orin (aarch64 + cuda)
aarch64
cross-platform
#1218
opened May 24, 2024 by
WangFengtu1996
[RFC] Cross-Platform Refactor: Testing and CI/CD Strategy
cicd
cross-platform
RFC
request for comments on proposed library improvements
#1031
opened Feb 4, 2024 by
Titus-von-Koeller
[RFC] Cross-Platform Refactor: CPU-only implementation
aarch64
cross-platform
RFC
request for comments on proposed library improvements
x64 CPU
[RFC] Cross-Platform Refactor: Mac M1 support
cross-platform
duplicate
This issue or pull request already exists
macOS
RFC
request for comments on proposed library improvements
#1020
opened Feb 3, 2024 by
rickardp
5 tasks
ImportError: Using A bug that is likely due to the interaction between bnb and HF libs (transformers, accelerate, peft)
load_in_8bit=True
requires Accelerate: pip install accelerate
and the latest version of bitsandbytes pip install -i https://test.pypi.org/simple/ bitsandbytes
or pip install bitsandbytes` when in reality it's a torch issue
cross-platform
huggingface-related
#837
opened Oct 22, 2023 by
dataf3l
Support for Apple silicon
cross-platform
duplicate
This issue or pull request already exists
enhancement
New feature or request
macOS
#252
opened Apr 1, 2023 by
rickardp
(Feature request) DirectML support
contributions-welcome
We welcome contributions to fix this issue!
cross-platform
Windows
#194
opened Mar 13, 2023 by
NotNite
ProTip!
Find all open issues with in progress development work with linked:pr.