File size: 437 Bytes
8d2c9d8 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 | ---
library_name: mlx
base_model: numind/NuExtract3
base_model_relation: quantized
tags:
- mlx
- mlx-vlm
- quantized
---
# numind/NuExtract3-mlx-nvfp4
MLX quantized version of `numind/NuExtract3`.
## Quantization
- mode: `nvfp4`
- group_size: `16`
- bits: `4`
- dtype: `source/default`
- quant_predicate: `none`
## Usage
```bash
pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-nvfp4 --prompt "your prompt"
``` |