The Model mlx-community/IBM-granite-3.2-2b-instruct-4bit was converted to MLX format from ibm-granite/granite-3.2-2b-instruct using mlx-lm version 0.21.3.

Downloads last month
68
Safetensors
Model size
3B params
Tensor type
U32
ยท
F16
ยท
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for mlx-community/IBM-granite-3.2-2b-instruct-4bit

Quantizations
1 model