| library_name: mlx | |
| base_model: numind/NuExtract3 | |
| base_model_relation: quantized | |
| tags: | |
| - mlx | |
| - mlx-vlm | |
| - quantized | |
| # numind/NuExtract3-mlx-5bits | |
| MLX quantized version of `numind/NuExtract3`. | |
| ## Quantization | |
| - mode: `affine` | |
| - group_size: `64` | |
| - bits: `5` | |
| - dtype: `source/default` | |
| - quant_predicate: `none` | |
| ## Usage | |
| ```bash | |
| pip install -U mlx-vlm | |
| mlx_vlm.generate --model numind/NuExtract3-mlx-5bits --prompt "your prompt" | |
| ``` |