Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

962

Base only

Active filters: language

mlx-community/granite-4.0-h-micro-8bit

Text Generation • Updated Oct 2, 2025 • 82 • 2

mlx-community/granite-4.0-h-tiny-8bit

Text Generation • Updated Oct 2, 2025 • 17

mlx-community/granite-4.0-micro-8bit

Text Generation • Updated Oct 2, 2025 • 18

mlx-community/granite-4.0-h-small-4bit

Text Generation • Updated Oct 2, 2025 • 21

mlx-community/Granite-4.0-H-Tiny-4bit-DWQ

Text Generation • 1B • Updated Oct 3, 2025 • 264 • 5

huihui-ai/Huihui-granite-4.0-micro-abliterated

Text Generation • 3B • Updated Oct 3, 2025 • 5 • 4

mradermacher/granite-4.0-micro-GGUF

3B • Updated Oct 3, 2025 • 125 • 1

mradermacher/Huihui-granite-4.0-micro-abliterated-GGUF

3B • Updated Oct 3, 2025 • 35 • 1

huihui-ai/Huihui-granite-4.0-h-micro-abliterated

Text Generation • 3B • Updated Oct 3, 2025 • 6 • 5

mradermacher/Huihui-granite-4.0-micro-abliterated-i1-GGUF

3B • Updated Dec 5, 2025 • 98 • 2

bunnycore/Huihui-granite-4.0-h-micro-abliterated-Q5_K_M-GGUF

3B • Updated Oct 3, 2025 • 10

mradermacher/granite-4.0-micro-i1-GGUF

3B • Updated Dec 5, 2025 • 333 • 1

huihui-ai/Huihui-granite-4.0-h-tiny-abliterated

Text Generation • 7B • Updated Oct 4, 2025 • 8 • 9

mlx-community/granite-4.0-h-micro-6bit

Text Generation • Updated Oct 4, 2025 • 5

mlx-community/granite-4.0-h-micro-4bit

Text Generation • Updated Oct 4, 2025 • 590 • 1

mlx-community/granite-4.0-h-tiny-4bit

Text Generation • Updated Oct 4, 2025 • 697

ethicalabs/granite-4.0-micro-MLX

Text Generation • 0.5B • Updated Oct 4, 2025 • 5

ethicalabs/granite-4.0-h-micro-MLX

Text Generation • 0.5B • Updated Oct 4, 2025 • 3

ethicalabs/granite-4.0-micro-base-MLX

Text Generation • 0.5B • Updated Oct 4, 2025 • 1

ethicalabs/granite-4.0-h-micro-base-MLX

Text Generation • 0.5B • Updated Oct 4, 2025 • 23 • 1

ethicalabs/granite-4.0-h-tiny-MLX

Text Generation • 1B • Updated Oct 4, 2025 • 1

ethicalabs/granite-4.0-h-tiny-base-MLX

Text Generation • 1B • Updated Oct 4, 2025 • 14 • 1

ethicalabs/granite-4.0-h-small-MLX

Text Generation • 32B • Updated Oct 4, 2025 • 2

mradermacher/Huihui-granite-4.0-h-micro-abliterated-GGUF

3B • Updated Oct 4, 2025 • 42 • 2

mradermacher/Huihui-granite-4.0-h-tiny-abliterated-GGUF

7B • Updated Oct 4, 2025 • 160 • 2

ethicalabs/granite-4.0-h-small-base-MLX

Text Generation • 32B • Updated Oct 4, 2025 • 5 • 1

mradermacher/Huihui-granite-4.0-h-micro-abliterated-i1-GGUF

3B • Updated Dec 6, 2025 • 160 • 2

mradermacher/Huihui-granite-4.0-h-tiny-abliterated-i1-GGUF

7B • Updated Dec 6, 2025 • 248 • 3

sizzlebop/Huihui-granite-4.0-h-micro-abliterated-Q8_0-GGUF

3B • Updated Oct 5, 2025 • 5

sizzlebop/Huihui-granite-4.0-h-micro-abliterated-IQ4_NL-GGUF

3B • Updated Oct 5, 2025 • 1