Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

962

Base only

Active filters: language

lmstudio-community/granite-4.0-h-tiny-MLX-8bit

Text Generation • 7B • Updated Sep 29, 2025 • 769 • 1

lmstudio-community/granite-4.0-h-small-MLX-4bit

Text Generation • 32B • Updated Sep 29, 2025 • 225

lmstudio-community/granite-4.0-h-small-MLX-5bit

Text Generation • 32B • Updated Sep 29, 2025 • 122

lmstudio-community/granite-4.0-h-small-MLX-6bit

Text Generation • 32B • Updated Sep 29, 2025 • 255 • 1

lmstudio-community/granite-4.0-h-small-MLX-8bit

Text Generation • 32B • Updated Sep 29, 2025 • 6.07k

ibm-granite/granite-4.0-h-small-FP8

Text Generation • 33B • Updated Oct 7, 2025 • 46.9k • 5

unsloth/granite-4.0-micro

Text Generation • 3B • Updated Oct 7, 2025 • 429 • 2

unsloth/granite-4.0-micro-GGUF

3B • Updated Oct 7, 2025 • 2.15k • 11

unsloth/granite-4.0-h-small

Text Generation • 32B • Updated Oct 7, 2025 • 26 • 4

unsloth/granite-4.0-h-small-GGUF

32B • Updated Oct 7, 2025 • 2.21k • 44

unsloth/granite-4.0-h-small-unsloth-bnb-4bit

Text Generation • 32B • Updated Oct 2, 2025 • 16 • 3

unsloth/granite-4.0-h-small-bnb-4bit

Text Generation • 32B • Updated Oct 1, 2025 • 7 • 2

unsloth/granite-4.0-h-micro

Text Generation • 3B • Updated Oct 7, 2025 • 194 • 2

unsloth/granite-4.0-h-micro-GGUF

3B • Updated Oct 7, 2025 • 18.9k • 16

unsloth/granite-4.0-micro-unsloth-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 1.53k • 3

unsloth/granite-4.0-micro-base

Text Generation • 3B • Updated Oct 7, 2025 • 10 • 2

unsloth/granite-4.0-micro-base-unsloth-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 12 • 2

unsloth/granite-4.0-h-micro-base

Text Generation • 3B • Updated Oct 7, 2025 • 34 • 1

unsloth/granite-4.0-micro-base-bnb-4bit

Text Generation • 4B • Updated Oct 7, 2025 • 2 • 2

unsloth/granite-4.0-h-tiny-GGUF

7B • Updated Oct 7, 2025 • 2.67k • 33

unsloth/granite-4.0-h-tiny

Text Generation • 7B • Updated Oct 7, 2025 • 986 • 4

unsloth/granite-4.0-h-micro-base-unsloth-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 3

unsloth/granite-4.0-h-micro-base-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 6 • 1

unsloth/granite-4.0-h-micro-unsloth-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 91 • 3

unsloth/granite-4.0-h-micro-bnb-4bit

Text Generation • 3B • Updated Oct 7, 2025 • 7 • 3

unsloth/granite-4.0-h-small-FP8-Dynamic

Text Generation • 33B • Updated Oct 7, 2025 • 11 • 3

unsloth/granite-4.0-h-tiny-FP8-Dynamic

Text Generation • 7B • Updated Nov 25, 2025 • 53 • 1

unsloth/granite-4.0-h-tiny-base

Text Generation • 7B • Updated Nov 6, 2025 • 3

unsloth/granite-4.0-h-small-base

32B • Updated Oct 7, 2025 • 8

mlx-community/granite-4.0-h-small-8bit

Text Generation • Updated Oct 2, 2025 • 15