Hugging Face's logo

Veer15
/
bloomz-3b-4bit-quant

Text Generation
PEFT
PyTorch
English
bloom
4-bit precision
gptq
Model card Files
xet
Community

Quantized bloomz-3b using peft(lora)
4 bit quant is used
GPU will be needed to use this model

Downloads last month
-
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support