How to use TheWirelessPhoenix/DeepSeek-R1-Distill-Qwen-7B-oQ4e with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir DeepSeek-R1-Distill-Qwen-7B-oQ4e TheWirelessPhoenix/DeepSeek-R1-Distill-Qwen-7B-oQ4e
library_name: mlx tags: - mlx - oq - quantized
This model was quantized using oQ (oMLX v0.5.3) mixed-precision quantization.
