File size: 438 Bytes
92fcde6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 | ---
library_name: mlx
base_model: numind/NuExtract3
base_model_relation: quantized
tags:
- mlx
- mlx-vlm
- quantized
---
# numind/NuExtract3-mlx-5bits
MLX quantized version of `numind/NuExtract3`.
## Quantization
- mode: `affine`
- group_size: `64`
- bits: `5`
- dtype: `source/default`
- quant_predicate: `none`
## Usage
```bash
pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-5bits --prompt "your prompt"
``` |