metadata
library_name: mlx
base_model: numind/NuExtract3
base_model_relation: quantized
tags:
- mlx
- mlx-vlm
- quantized
numind/NuExtract3-mlx-nvfp4
MLX quantized version of numind/NuExtract3.
Quantization
- mode:
nvfp4 - group_size:
16 - bits:
4 - dtype:
source/default - quant_predicate:
none
Usage
pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-nvfp4 --prompt "your prompt"