Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,031

Base only

Active filters: language

unsloth/granite-4.0-h-small-unsloth-bnb-4bit

Text Generation • 32B • Updated Oct 2, 2025 • 18 • 3

unsloth/granite-4.0-h-small-bnb-4bit

Text Generation • 32B • Updated Oct 1, 2025 • 12 • 2

unsloth/granite-4.0-h-micro

Text Generation • 3B • Updated Oct 7, 2025 • 86 • 2

unsloth/granite-4.0-h-micro-GGUF

3B • Updated Oct 7, 2025 • 1.65k • 18

unsloth/granite-4.0-micro-unsloth-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 278 • 3

unsloth/granite-4.0-micro-base

Text Generation • 3B • Updated Oct 7, 2025 • 16 • 2

unsloth/granite-4.0-micro-base-unsloth-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 19 • 2

unsloth/granite-4.0-h-micro-base

Text Generation • 3B • Updated Oct 7, 2025 • 34 • 1

unsloth/granite-4.0-micro-base-bnb-4bit

Text Generation • 4B • Updated Oct 7, 2025 • 10 • 2

unsloth/granite-4.0-h-tiny-GGUF

7B • Updated Oct 7, 2025 • 3.05k • 37

unsloth/granite-4.0-h-tiny

Text Generation • 7B • Updated Oct 7, 2025 • 670 • 4

unsloth/granite-4.0-h-micro-base-unsloth-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 10

unsloth/granite-4.0-h-micro-base-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 10 • 1

unsloth/granite-4.0-h-micro-unsloth-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 22 • 3

unsloth/granite-4.0-h-micro-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 14 • 3

unsloth/granite-4.0-h-small-FP8-Dynamic

Text Generation • 33B • Updated Oct 7, 2025 • 21 • 3

unsloth/granite-4.0-h-tiny-FP8-Dynamic

Text Generation • 7B • Updated Nov 25, 2025 • 17 • 1

unsloth/granite-4.0-h-tiny-base

Text Generation • 7B • Updated Nov 6, 2025 • 18

unsloth/granite-4.0-h-small-base

32B • Updated Oct 7, 2025 • 13

mlx-community/granite-4.0-h-small-8bit

Text Generation • 32B • Updated Oct 2, 2025 • 16

mlx-community/granite-4.0-h-micro-8bit

Text Generation • 0.9B • Updated Oct 2, 2025 • 64 • 2

mlx-community/granite-4.0-h-tiny-8bit

Text Generation • 7B • Updated Oct 2, 2025 • 20

mlx-community/granite-4.0-micro-8bit

Text Generation • 1.0B • Updated Oct 2, 2025 • 16

mlx-community/granite-4.0-h-small-4bit

Text Generation • 32B • Updated Oct 2, 2025 • 45

mlx-community/Granite-4.0-H-Tiny-4bit-DWQ

Text Generation • 1B • Updated Oct 3, 2025 • 162 • 5

huihui-ai/Huihui-granite-4.0-micro-abliterated

Text Generation • 3B • Updated Oct 3, 2025 • 9 • 5

mradermacher/granite-4.0-micro-GGUF

3B • Updated Oct 3, 2025 • 187 • 1

mradermacher/Huihui-granite-4.0-micro-abliterated-GGUF

3B • Updated Oct 3, 2025 • 67 • 1

huihui-ai/Huihui-granite-4.0-h-micro-abliterated

Text Generation • 3B • Updated Oct 3, 2025 • 151 • 5

mradermacher/Huihui-granite-4.0-micro-abliterated-i1-GGUF

3B • Updated Dec 5, 2025 • 149 • 2