Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

962

Base only

Active filters: language

mlx-community/granite-3.3-8b-instruct-8bit

Text Generation • Updated Apr 16, 2025 • 34 • 2

mlx-community/granite-3.3-8b-instruct-6bit

Text Generation • Updated Apr 16, 2025 • 3 • 1

LogicBombaklot/granite-3.3-8b-instruct-mlx-8Bit

Text Generation • 2B • Updated Apr 16, 2025 • 2

mlx-community/granite-3.3-8b-instruct-4bit

Text Generation • Updated Apr 16, 2025 • 126 • 1

mlx-community/granite-3.3-2b-instruct-fp16

Text Generation • Updated Apr 16, 2025 • 22 • 1

mlx-community/granite-3.3-2b-instruct-8bit

Text Generation • Updated Apr 16, 2025 • 5

mlx-community/granite-3.3-2b-instruct-6bit

Text Generation • Updated Apr 16, 2025 • 7

mlx-community/granite-3.3-2b-instruct-4bit

Text Generation • Updated Apr 16, 2025 • 1.05k • 1

NikolayKozloff/granite-3.3-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Apr 16, 2025 • 2 • 2

NikolayKozloff/granite-3.3-2b-instruct-Q8_0-GGUF

Text Generation • 3B • Updated Apr 16, 2025 • 3 • 1

stelterlab/granite-3.3-8b-instruct-FP8-Dynamic

Text Generation • 8B • Updated Apr 16, 2025 • 3

cgus/granite-3.3-8b-instruct-exl2

Text Generation • Updated Apr 16, 2025 • 3

mradermacher/granite-3.3-2b-instruct-GGUF

3B • Updated Jul 11, 2025 • 63 • 2

mradermacher/granite-3.3-2b-base-GGUF

3B • Updated Jul 11, 2025 • 72

mradermacher/granite-3.3-8b-base-GGUF

8B • Updated Jul 11, 2025 • 16 • 2

mradermacher/granite-3.3-2b-base-i1-GGUF

3B • Updated Jul 11, 2025 • 121

mradermacher/granite-3.3-8b-instruct-GGUF

8B • Updated Jul 11, 2025 • 75

mradermacher/granite-3.3-2b-instruct-i1-GGUF

3B • Updated Jul 11, 2025 • 149 • 2

mradermacher/granite-3.3-8b-base-i1-GGUF

8B • Updated Jul 11, 2025 • 140

mradermacher/granite-3.3-8b-instruct-i1-GGUF

8B • Updated Jul 11, 2025 • 159

pankaj217/granite-3.3-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Apr 17, 2025 • 3

bartowski/ibm-granite_granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Apr 17, 2025 • 2.39k • 3

lmstudio-community/granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Apr 17, 2025 • 88

bartowski/ibm-granite_granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 17, 2025 • 2.46k • 5

lmstudio-community/granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 17, 2025 • 184 • 3

Mungert/granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Sep 24, 2025 • 81 • 5

samuellimabraz/granite-3.3-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Apr 18, 2025 • 11

unsloth/granite-3.3-2b-instruct

Text Generation • 3B • Updated Apr 18, 2025 • 8 • 2

cgus/granite-3.3-2b-instruct-exl2

Text Generation • Updated Apr 19, 2025 • 1

IntervitensInc/granite-3.3-8b-instruct-chatml

Text Generation • 8B • Updated Apr 21, 2025 • 3