Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,031

Base only

Active filters: language

mlx-community/granite-3.3-2b-instruct-8bit

Text Generation • 0.7B • Updated Apr 16, 2025 • 16

mlx-community/granite-3.3-2b-instruct-6bit

Text Generation • 0.6B • Updated Apr 16, 2025 • 13

mlx-community/granite-3.3-2b-instruct-4bit

Text Generation • 0.4B • Updated Apr 16, 2025 • 512 • 1

NikolayKozloff/granite-3.3-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Apr 16, 2025 • 30 • 2

NikolayKozloff/granite-3.3-2b-instruct-Q8_0-GGUF

Text Generation • 3B • Updated Apr 16, 2025 • 3 • 1

stelterlab/granite-3.3-8b-instruct-FP8-Dynamic

Text Generation • 8B • Updated Apr 16, 2025 • 6

cgus/granite-3.3-8b-instruct-exl2

Text Generation • Updated Apr 16, 2025 • 6

mradermacher/granite-3.3-2b-instruct-GGUF

3B • Updated Jul 11, 2025 • 70 • 2

mradermacher/granite-3.3-2b-base-GGUF

3B • Updated Jul 11, 2025 • 68

mradermacher/granite-3.3-8b-base-GGUF

8B • Updated Jul 11, 2025 • 100 • 2

mradermacher/granite-3.3-2b-base-i1-GGUF

3B • Updated Jul 11, 2025 • 118

mradermacher/granite-3.3-8b-instruct-GGUF

8B • Updated Jul 11, 2025 • 43

mradermacher/granite-3.3-2b-instruct-i1-GGUF

3B • Updated Jul 11, 2025 • 155 • 2

mradermacher/granite-3.3-8b-base-i1-GGUF

8B • Updated Jul 11, 2025 • 364

mradermacher/granite-3.3-8b-instruct-i1-GGUF

8B • Updated Jul 11, 2025 • 125

pankaj217/granite-3.3-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Apr 17, 2025 • 8

bartowski/ibm-granite_granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Apr 17, 2025 • 1.17k • 3

lmstudio-community/granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Apr 17, 2025 • 679

bartowski/ibm-granite_granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 17, 2025 • 1.01k • 5

lmstudio-community/granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 17, 2025 • 367 • 3

Mungert/granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Sep 24, 2025 • 142 • 5

samuellimabraz/granite-3.3-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Apr 18, 2025 • 17

unsloth/granite-3.3-2b-instruct

Text Generation • 3B • Updated Apr 18, 2025 • 95 • 2

cgus/granite-3.3-2b-instruct-exl2

Text Generation • Updated Apr 19, 2025 • 25

IntervitensInc/granite-3.3-8b-instruct-chatml

Text Generation • 8B • Updated Apr 21, 2025 • 10

cobrakenji/granite-3.3-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 22, 2025 • 6

Fmuaddib/granite-3.3-8b-instruct-mlx-8Bit

Text Generation • 2B • Updated Apr 25, 2025 • 6

Fmuaddib/granite-3.3-8b-instruct-mlx-fp16

Text Generation • 8B • Updated Apr 25, 2025 • 7

lawrencenull/granite-3.3-8b-instruct-Q2_K-GGUF

Text Generation • 8B • Updated Apr 26, 2025 • 11

tensorblock/ibm-granite_granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Jan 27 • 26