Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,031

Base only

Active filters: language

ibm-granite/granite-4.0-1b

Text Generation • 2B • Updated Oct 23, 2025 • 6.43k • 53

ibm-granite/granite-4.0-1b-base

Text Generation • 2B • Updated Jun 12 • 8.7k • 32

ibm-granite/granite-4.0-350m

Text Generation • 0.4B • Updated Oct 23, 2025 • 11.6k • 65

ibm-granite/granite-4.0-350m-base

Text Generation • 0.4B • Updated Oct 23, 2025 • 24k • 26

mradermacher/granite-4.0-h-small-i1-GGUF

32B • Updated Dec 9, 2025 • 215

cyankiwi/granite-4.0-h-micro-AWQ-4bit

Text Generation • 3B • Updated 20 days ago • 52

cyankiwi/granite-4.0-h-micro-AWQ-8bit

Text Generation • 3B • Updated 20 days ago • 21

saputra15/english-grammar-coach

Updated Oct 11, 2025 • 1

cyankiwi/granite-4.0-h-tiny-AWQ-4bit

Text Generation • 2B • Updated 20 days ago • 373 • 3

cyankiwi/granite-4.0-h-tiny-AWQ-8bit

Text Generation • 3B • Updated 20 days ago • 25

cyankiwi/granite-4.0-h-small-AWQ-4bit

Text Generation • 10B • Updated 20 days ago • 36 • 1

cyankiwi/granite-4.0-h-small-AWQ-8bit

Text Generation • 13B • Updated 20 days ago • 22 • 1

thelamapi/next-4b

Image-Text-to-Text • 4B • Updated Mar 1 • 83 • 9

ibm-granite/granite-3.3-8b-instruct-FP8

Text Generation • 8B • Updated Oct 17, 2025 • 4.49k • 3

Mungert/granite-4.0-micro-GGUF

3B • Updated Oct 21, 2025 • 34

marianbasti/audio-language-classification

Audio Classification • Updated Oct 21, 2025 • 1

Mungert/granite-4.0-h-tiny-GGUF

7B • Updated Oct 21, 2025 • 72

Mungert/granite-4.0-h-micro-GGUF

3B • Updated Oct 21, 2025 • 45

r0x0d/granite-embedding-30m-english-Q4_K_M-GGUF

Sentence Similarity • 30.1M • Updated Oct 21, 2025 • 19

mattritchey/next-4b-Q4_K_M-GGUF

Text Generation • 4B • Updated Oct 21, 2025 • 6

Mungert/granite-4.0-micro-base-GGUF

3B • Updated Oct 22, 2025 • 149

RepublicOfKorokke/granite-4.0-h-tiny-mlx-mxfp4

Text Generation • 1B • Updated Oct 23, 2025 • 8

RepublicOfKorokke/granite-4.0-h-micro-mlx-mxfp4

Text Generation • 0.6B • Updated Oct 23, 2025 • 4

RepublicOfKorokke/granite-4.0-micro-mlx-mxfp4

Text Generation • 0.6B • Updated Oct 23, 2025 • 10

ibm-granite/granite-4.0-350m-GGUF

0.4B • Updated Apr 23 • 1.19k • 9

ibm-granite/granite-4.0-350m-base-GGUF

0.4B • Updated Apr 23 • 276 • 1

ibm-granite/granite-4.0-h-350m-GGUF

0.3B • Updated Apr 23 • 1.63k • 5

ibm-granite/granite-4.0-h-350m-base-GGUF

0.3B • Updated Apr 23 • 583 • 4

ibm-granite/granite-4.0-1b-GGUF

2B • Updated Apr 23 • 2.84k • 5

ibm-granite/granite-4.0-h-1b-GGUF

1B • Updated Apr 23 • 1.98k • 6