YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

MLX Format and Quantizations for Unslop Nemo 12b v4

Quantized to 8-bit precision and tested using the mlx_lm utility on a 64GiB URAM M1 Max.

See original model for further details.

Downloads last month
2
Safetensors
Model size
3B params
Tensor type
F16
·
U32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support