README.md

metadata

library_name: mlx
tags:
  - mlx
  - oq
  - quantized

mistral-7b-oQ4e

This model was quantized using oQ (oMLX v0.5.3) mixed-precision quantization.

Quantization details

• Model type: mistral
• Bits: 4
• Group size: 64
• Format: MLX safetensors