AX-DeepSeek-OCR-2-MLX-AXQ-6bit

Development AXQuant (AXQ) 6-bit language MLX pack of deepseek-ai/DeepSeek-OCR-2 @ aaa02f3811945a91062062994c5c4a3f4c0af2b0.

Language experts/attention/MLP at 6-bit; vision towers BF16-preserved. Total BPW includes large BF16 vision (policy minimum ~8.3 when 4-bit is excluded).

Converted via MLX-VLM deepseekocr_2 from mlx-community/DeepSeek-OCR-2-bf16 @ 9946f9ac306378a3e6a86cad7d7f8be8e536f092.

Claims

Claim Status
AXQuant architecture-prior / development quant Yes
OCR accuracy / document-bench scores Not claimed
Vision optimization No — SAM + Qwen2 encoder + projector BF16-preserved
Certified release No

Attribution

Base weights © DeepSeek AI (Apache-2.0). Quantization by AXQuant (development).

Downloads last month
68
Safetensors
Model size
1B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AutomatosX/AX-DeepSeek-OCR-2-MLX-AXQ-6bit

Quantized
(9)
this model

Collections including AutomatosX/AX-DeepSeek-OCR-2-MLX-AXQ-6bit