Quantized Models
Collection
Collection of quantized model for deployment
•
11 items
•
Updated
No model card
- Downloads last month
- 25
Hardware compatibility
Log In
to add your hardware
4-bit
5-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support