metadata
library_name: mlx
base_model: numind/NuExtract3
base_model_relation: quantized
tags:
- mlx
- mlx-vlm
- quantized
numind/NuExtract3-mlx-5bits
MLX quantized version of numind/NuExtract3.
Quantization
- mode:
affine - group_size:
64 - bits:
5 - dtype:
source/default - quant_predicate:
none
Usage
pip install -U mlx-vlm
mlx_vlm.generate --model numind/NuExtract3-mlx-5bits --prompt "your prompt"