---
library_name: mlx
base_model: numind/NuExtract3
base_model_relation: quantized
tags:
- mlx
- mlx-vlm
- quantized
---

# numind/NuExtract3-mlx-4bits

MLX quantized version of `numind/NuExtract3`.

## Quantization

- mode: `affine`
- group_size: `64`
- bits: `4`
- dtype: `source/default`
- quant_predicate: `none`

## Usage

```bash
pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-4bits --prompt "your prompt"
```