AKSazgar's picture
Add 8-bit quantization to reduce memory usage
0973284
torch>=2.0.0
transformers>=4.45.0
accelerate>=0.20.0
bitsandbytes>=0.41.0
Pillow>=10.0.0
sentencepiece>=0.1.99
protobuf>=3.20.0