ibm-granite/granite-4.1-8b-fp8
Text Generation • 9B • Updated • 9.2k • 12
Granite Quantized Models
Quantized versions of IBM Granite models.
-
-
ibm-granite/granite-4.1-3b-fp8
Text Generation • 4B • Updated • 3.83k • 7 -
ibm-granite/granite-4.1-30b-fp8
Text Generation • 29B • Updated • 3.82k • 8 -
ibm-granite/granite-4.0-h-tiny-GGUF
7B • Updated • 6.78k • 22 -
ibm-granite/granite-4.0-h-small-FP8
Text Generation • 33B • Updated • 9.17k • 5 -
ibm-granite/granite-4.0-micro-GGUF
3B • Updated • 3.72k • 21 -
ibm-granite/granite-4.0-micro-base-GGUF
3B • Updated • 1.5k • 4 -
ibm-granite/granite-4.0-h-micro-GGUF
3B • Updated • 2.47k • 18 -
ibm-granite/granite-4.0-h-micro-base-GGUF
3B • Updated • 1.28k • 1 -
ibm-granite/granite-4.0-h-tiny-base-GGUF
7B • Updated • 1.25k • 3 -
ibm-granite/granite-3.3-8b-base-GGUF
Text Generation • 8B • Updated • 212 • 1 -
ibm-granite/granite-4.0-h-small-GGUF
32B • Updated • 1.32k • 24 -
ibm-granite/granite-4.0-h-small-base-GGUF
32B • Updated • 663 • 4 -
ibm-granite/granite-4.0-tiny-preview-GGUF
Text Generation • 7B • Updated • 253 • 6 -
ibm-granite/granite-4.0-tiny-base-preview-GGUF
7B • Updated • 280 • 2 -
ibm-granite/granite-3.3-2b-instruct-GGUF
Text Generation • 3B • Updated • 613 • 14 -
ibm-granite/granite-3.3-2b-base-GGUF
Text Generation • 3B • Updated • 129 • 2 -
ibm-granite/granite-3.3-8b-instruct-GGUF
Text Generation • 8B • Updated • 1.39k • 36 -
ibm-granite/granite-4.0-h-1b-GGUF
1B • Updated • 2k • 3 -
ibm-granite/granite-guardian-3.3-8b-GGUF
Text Generation • 8B • Updated • 200 • 1 -
ibm-granite/granite-vision-3.3-2b-GGUF
3B • Updated • 1.37k • 14 -
ibm-research/granite-3.2-2b-instruct-GGUF
Text Generation • 3B • Updated • 369 • 12 -
ibm-research/granite-3.2-8b-instruct-GGUF
Text Generation • 8B • Updated • 235 • 9 -
ibm-research/granite-guardian-3.2-3b-a800m-GGUF
Text Generation • 3B • Updated • 350 • 3 -
ibm-research/granite-guardian-3.2-5b-GGUF
Text Generation • 6B • Updated • 171 • 2 -
ibm-research/granite-vision-3.2-2b-GGUF
3B • Updated • 329 • 12 -
ibm-granite/granite-4.0-h-350m-GGUF
0.3B • Updated • 1.54k • 4 -
ibm-granite/granite-4.0-h-350m-base-GGUF
0.3B • Updated • 1.19k • 4 -
ibm-granite/granite-3.3-8b-instruct-FP8
Text Generation • 8B • Updated • 6.46k • 3 -
ibm-granite/granite-4.0-1b-GGUF
2B • Updated • 2.11k • 4 -
ibm-granite/granite-4.0-350m-GGUF
0.4B • Updated • 2.28k • 7 -
ibm-granite/granite-4.0-1b-base-GGUF
2B • Updated • 1.3k • 3 -
ibm-granite/granite-4.0-350m-base-GGUF
0.4B • Updated • 1.08k • 1 -
ibm-granite/granite-4.0-h-1b-base-GGUF
1B • Updated • 1.25k • 3 -
ibm-granite/granite-docling-258M-GGUF
0.2B • Updated • 1.07k • 11 -
ibm-granite/granite-vision-3.3-2b-chart2csv-preview-GGUF
3B • Updated • 89 • 2 -
ibm-granite/granite-4.1-3b-GGUF
Text Generation • 3B • Updated • 386 -
ibm-granite/granite-4.1-8b-GGUF
Text Generation • 9B • Updated • 456 -
ibm-granite/granite-4.1-30b-GGUF
Text Generation • 29B • Updated • 232 • 1