Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

962

Base only

Active filters: language

elichen-skymizer/granite-3.1-1b-a400m-base-Q3_K_M-GGUF

Text Generation • 1B • Updated Jul 17, 2025 • 28

elichen-skymizer/granite-4.0-tiny-base-preview-Q8_0-GGUF

7B • Updated Jul 17, 2025 • 1

elichen-skymizer/granite-4.0-tiny-base-preview-Q6_K-GGUF

7B • Updated Jul 17, 2025 • 8

elichen-skymizer/granite-4.0-tiny-base-preview-Q5_K_M-GGUF

7B • Updated Jul 17, 2025 • 1

elichen-skymizer/granite-4.0-tiny-base-preview-Q4_K_M-GGUF

7B • Updated Jul 17, 2025 • 2

elichen-skymizer/granite-4.0-tiny-base-preview-Q3_K_M-GGUF

7B • Updated Jul 17, 2025 • 9

tensorblock/RedHatAI_granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Jan 27 • 21

Mungert/granite-4.0-tiny-preview-GGUF

Text Generation • 7B • Updated Sep 24, 2025 • 70 • 6

mradermacher/aquif-moe-400m-GGUF

1B • Updated Sep 7, 2025 • 95 • 1

mradermacher/aquif-moe-400m-i1-GGUF

1B • Updated Dec 18, 2025 • 374

pasan1992/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 27, 2025 • 1

pasan1992/granite-3.3-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 27, 2025 • 5

mradermacher/aquif-3-micro-GGUF

0.4B • Updated Sep 7, 2025 • 61

mradermacher/aquif-3-micro-i1-GGUF

0.4B • Updated Dec 25, 2025 • 210

mradermacher/aquif-3-moe-17b-a2.8b-GGUF

17B • Updated Sep 7, 2025 • 94 • 4

mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF

17B • Updated Dec 25, 2025 • 177

mradermacher/aquif-3-moe-17b-a2.8b-thinking-GGUF

17B • Updated Sep 7, 2025 • 59

koureasstavros/TheLittleBaby

Updated Dec 23, 2025 • 1

mradermacher/aquif-3-moe-17b-a2.8b-thinking-i1-GGUF

17B • Updated Jan 1 • 37

mradermacher/aquif-3-mini-GGUF

3B • Updated Sep 7, 2025 • 74

mradermacher/aquif-3-mini-i1-GGUF

3B • Updated Jan 1 • 172

ibm-granite/granite-vision-3.3-2b-GGUF

3B • Updated Mar 13 • 1.47k • 14

ibm-granite/granite-4.0-tiny-preview-GGUF

Text Generation • 7B • Updated Aug 12, 2025 • 318 • 6

ibm-granite/granite-4.0-tiny-base-preview-GGUF

7B • Updated Aug 12, 2025 • 410 • 2

shindy-dev/granite-embedding-278m-shindy-multilingual-GGUF

Text Generation • 0.3B • Updated Aug 16, 2025 • 9

mradermacher/aquif-3.5-3B-GGUF

3B • Updated Sep 7, 2025 • 93

mradermacher/aquif-3.5-3B-i1-GGUF

3B • Updated Dec 23, 2025 • 213

mradermacher/aquif-3.5-7B-GGUF

7B • Updated Sep 7, 2025 • 85 • 1

mradermacher/aquif-3.5-7B-i1-GGUF

7B • Updated Dec 23, 2025 • 191 • 1

mradermacher/aquif-3.5-8B-Think-GGUF

8B • Updated Sep 7, 2025 • 85 • 2