The Model mlx-community/IBM-granite-3.2-2b-instruct-4bit was converted to MLX format from ibm-granite/granite-3.2-2b-instruct using mlx-lm version 0.21.3.

Downloads last month
17
Safetensors
Model size
0.4B params
Tensor type
F16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mlx-community/IBM-granite-3.2-2b-instruct-4bit

Quantizations
1 model