bitsandbytes
Quantization and optimization library for large model fine-tuning.
About bitsandbytes
bitsandbytes enables low-memory training with 8-bit/4-bit methods.
Quantization and optimization library for large model fine-tuning.