How to use pxleng/DeepSeek-Coder-V2-Lite-Instruct-oQ4e with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir DeepSeek-Coder-V2-Lite-Instruct-oQ4e pxleng/DeepSeek-Coder-V2-Lite-Instruct-oQ4e
library_name: mlx tags: - mlx - oq - quantized
This model was quantized using oQ (oMLX v0.5.7) mixed-precision quantization.
