OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
Paper • 2308.13137 • Published • 19
3-bit OmniQuant quantized version of Replete-Coder-Llama3-8B.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support