bitsandbytes¶
bitsandbytes enables accessible large language models via k-bit quantization for PyTorch.
homepage: https://huggingface.co/docs/bitsandbytes/main/en/index
| version | versionsuffix | toolchain |
|---|---|---|
0.43.3 |
-CUDA-12.1.1 |
foss/2023a |
0.43.3 |
foss/2023a |
|
0.46.1 |
-CUDA-12.6.0 |
foss/2024a |
0.46.1 |
foss/2024a |
|
0.49.2 |
-CUDA-12.8.0 |
foss/2025a |
0.49.2 |
foss/2025a |
(quick links: (all) - 0 - a - b - c - d - e - f - g - h - i - j - k - l - m - n - o - p - q - r - s - t - u - v - w - x - y - z)