How to use from the
Use from the
MLX library
# Download the model from the Hub
pip install huggingface_hub[hf_xet]

huggingface-cli download --local-dir OlympicCoder-7B-mlx-8bit Lowkey-Loki/OlympicCoder-7B-mlx-8bit

Quantized 8bit MLX version of: https://huggingface.co/open-r1/OlympicCoder-7B

Downloads last month
1
Safetensors
Model size
2B params
Tensor type
F16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Lowkey-Loki/OlympicCoder-7B-mlx-8bit

Base model

Qwen/Qwen2.5-7B
Quantized
(22)
this model