Edit Models filters

Model Tree

ibm-granite/granite-3.1-2b-instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

28

Full-text search

Active filters: ibm-granite/granite-3.1-2b-instruct

bartowski/granite-3.1-2b-instruct-GGUF

Text Generation • 3B • Updated Dec 23, 2024 • 1.12k • 4

lmstudio-community/granite-3.1-2b-instruct-GGUF

Text Generation • 3B • Updated Dec 23, 2024 • 59 • 1

NikolayKozloff/granite-3.1-2b-instruct-Q8_0-GGUF

Text Generation • 3B • Updated Dec 18, 2024 • 13 • 1

DevQuasar-6/ibm-granite.granite-3.1-2b-instruct-GGUF

Text Generation • 3B • Updated Feb 1, 2025 • 20

mradermacher/granite-3.1-2b-instruct-GGUF

3B • Updated Dec 20, 2024 • 87

mradermacher/granite-3.1-2b-instruct-i1-GGUF

3B • Updated Dec 20, 2024 • 73

skarmani/granite-3.1-2b-instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Dec 21, 2024 • 13

itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 23, 2024 • 17

tensorblock/granite-3.1-2b-instruct-GGUF

Text Generation • 3B • Updated Jan 27 • 17

Alcoft/granite-3.1-2b-instruct-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 373

msyukorai/granite-3.1-2b-instruct-Q4_0-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 2

RedHatAI/granite-3.1-2b-instruct-FP8-dynamic

Text Generation • 3B • Updated Jan 28, 2025 • 32

RedHatAI/granite-3.1-2b-instruct-quantized.w8a8

Text Generation • 3B • Updated Feb 28, 2025 • 84

RedHatAI/granite-3.1-2b-instruct-quantized.w4a16

Text Generation • 0.5B • Updated Feb 28, 2025 • 62.4k

cgus/granite-3.1-2b-instruct-exl2

Text Generation • Updated Jan 22, 2025 • 4

ruslanmv/granite-3.1-2b-Reasoning-GGUF

Text Generation • 3B • Updated Feb 12, 2025 • 26

ruslanmv/granite-3.1-2b-Reasoning-4bit

Text Generation • 3B • Updated Feb 11, 2025 • 5

ObeJ/granite-3.1-2b-instruct-Q2_K-GGUF

Text Generation • 3B • Updated Feb 17, 2025 • 6

Lucy-in-the-Sky/granite-3.1-2b-instruct-Q8_0-GGUF

Text Generation • 3B • Updated Feb 17, 2025 • 3

Lucy-in-the-Sky/granite-3.1-2b-instruct-Q6_K-GGUF

Text Generation • 3B • Updated Feb 17, 2025

Lucy-in-the-Sky/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Feb 17, 2025 • 2

Mungert/granite-3.2-2b-instruct-GGUF

Text Generation • 3B • Updated Sep 24, 2025 • 28 • 6

taronaeo/Granite-3.1-2B-Instruct-BE-GGUF

Text Generation • 3B • Updated Jul 9, 2025 • 53

pasan1992/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 27, 2025

jesusoctavioas/Granite-3.1-2b-instruct-Q4_K_M.gguf

3B • Updated Nov 1, 2025 • 5

keisuke-miyako/granite-3.1-2b-instruct-onnx-int4

Updated Feb 18 • 4

Prithwiraj731/Granite-3.1-2b-FourWheeler

Text Generation • 3B • Updated Feb 16 • 6

Prithwiraj731/Granite-3.1-2b-TwoWheeler

Text Generation • 3B • Updated Feb 16 • 7