Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

962

Base only

Active filters: language

Mungert/granite-4.0-h-tiny-GGUF

7B • Updated Oct 21, 2025 • 536

Mungert/granite-4.0-h-micro-GGUF

3B • Updated Oct 21, 2025 • 1.17k

r0x0d/granite-embedding-30m-english-Q4_K_M-GGUF

Sentence Similarity • 30.1M • Updated Oct 21, 2025 • 16

mattritchey/next-4b-Q4_K_M-GGUF

Text Generation • 4B • Updated Oct 21, 2025 • 24

Mungert/granite-4.0-micro-base-GGUF

3B • Updated Oct 22, 2025 • 182

RepublicOfKorokke/granite-4.0-h-tiny-mlx-mxfp4

Text Generation • 1B • Updated Oct 23, 2025 • 8

RepublicOfKorokke/granite-4.0-h-micro-mlx-mxfp4

Text Generation • 0.6B • Updated Oct 23, 2025 • 11

RepublicOfKorokke/granite-4.0-micro-mlx-mxfp4

Text Generation • 0.6B • Updated Oct 23, 2025 • 2

ibm-granite/granite-4.0-350m-GGUF

0.4B • Updated Apr 23 • 1.75k • 7

ibm-granite/granite-4.0-350m-base-GGUF

0.4B • Updated Apr 23 • 174 • 1

ibm-granite/granite-4.0-h-350m-GGUF

0.3B • Updated Apr 23 • 1.06k • 4

ibm-granite/granite-4.0-h-350m-base-GGUF

0.3B • Updated Apr 23 • 263 • 4

ibm-granite/granite-4.0-1b-GGUF

2B • Updated Apr 23 • 1.21k • 4

ibm-granite/granite-4.0-h-1b-GGUF

1B • Updated Apr 23 • 1.17k • 5

ibm-granite/granite-4.0-1b-base-GGUF

2B • Updated Apr 23 • 366 • 3

ibm-granite/granite-4.0-h-1b-base-GGUF

1B • Updated Apr 23 • 289 • 3

onnx-community/granite-4.0-350m-ONNX-web

Text Generation • Updated Oct 28, 2025 • 353 • 5

onnx-community/granite-4.0-1b-ONNX-web

Text Generation • Updated Oct 28, 2025 • 192 • 2

ExaltedSlayer/ibm-granite-4.0-h-small-mlx-mxfp4

32B • Updated Oct 26, 2025 • 72 • 1

vraiti/granite-3.3-2b-f16-GGUF

3B • Updated Oct 27, 2025 • 5

thelamapi/next-12b

Image-Text-to-Text • 12B • Updated Mar 1 • 132 • • 14

Lamapi/next-4b-Q6_K-GGUF

Image-Text-to-Text • 4B • Updated Oct 28, 2025 • 36 • 2

unsloth/granite-4.0-h-350m

Text Generation • 0.3B • Updated Oct 28, 2025 • 146 • 2

Lamapi/next-4b-Q5_K_M-GGUF

Image-Text-to-Text • 4B • Updated Oct 28, 2025 • 35 • 3

unsloth/granite-4.0-h-350m-GGUF

0.3B • Updated Oct 28, 2025 • 800 • 9

Lamapi/next-4b-Q2_K-GGUF

Image-Text-to-Text • 4B • Updated Oct 28, 2025 • 25 • 2

Lamapi/next-4b-Q3_K_S-GGUF

Image-Text-to-Text • 4B • Updated Oct 28, 2025 • 38 • 2

unsloth/granite-4.0-350m

Text Generation • 0.4B • Updated Oct 28, 2025 • 1.73k

unsloth/granite-4.0-350m-GGUF

0.4B • Updated Oct 28, 2025 • 3.52k • 8

Lamapi/next-4b-Q3_K_M-GGUF

Image-Text-to-Text • 4B • Updated Oct 28, 2025 • 36 • 2