Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,845

Base only

Active filters: llama.cpp

sinimiini/HRM-Text-1B-GGUF

Text Generation • 1B • Updated May 21 • 904 • 21

Brian6145/Qwen3.6-27B-Claude-Opus-Sonnet-DistilledV2-MTP-GGUF

Text Generation • 27B • Updated May 23 • 2.22k • 15

GrahLnn/Hy-MT2-30B-A3B-4bit-GGUF

Text Generation • 30B • Updated May 23 • 271 • 11

v102ss/Alice-Qwopus3.5-9B-RP-GGUF

Text Generation • 9B • Updated May 24 • 80 • 1

jedisct1/MiMo-V2.5-coder-Q2

Text Generation • 309B • Updated Jun 8 • 213 • 77

Jackrong/Qwopus3.5-4B-Coder-GGUF

Image-Text-to-Text • 4B • Updated May 30 • 5.72k • 32

RootMonsteR/Qwen3-14B-Abliterated-GGUF

Text Generation • 15B • Updated May 31 • 4.37k • 1

notSnix/Step-3.7-Flash-Q4_K_M-MTP-GGUF

Text Generation • 197B • Updated Jun 3 • 305 • 14

XCurOS/XCurOS-OCR-GGUF

Image-Text-to-Text • 0.9B • Updated Jun 1 • 71 • 1

JetBrains/Mellum2-12B-A2.5B-Thinking-GGUF-Q8_0

Text Generation • 12B • Updated Jun 4 • 642 • 21

JetBrains/Mellum2-12B-A2.5B-Thinking-GGUF-MXFP4_MOE

Text Generation • 12B • Updated Jun 4 • 342 • 12

kread/llama-nemotron-rerank-1b-v2-GGUF

Text Ranking • 1B • Updated 27 days ago • 474 • 1

JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q8_0

Text Generation • 12B • Updated Jun 4 • 92.2k • 7

Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 6 • 2.06k • 38

Jianqiao1/Qwen3.6-27B-MTP-MoQ-GGUF

27B • Updated 17 days ago • 7.34k • 13

Janvitos/gemma-4-26B-A4B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 8 • 388 • 4

Janvitos/gemma-4-31B-it-qat-assistant-MTP-Q8_0-GGUF

0.5B • Updated Jun 8 • 245 • 5

Vegss/Step-3.7-Flash-AEON-Ultimate-Abliterated-GGUF

Image-Text-to-Text • 197B • Updated Jun 8 • 77 • 1

SevenOfNine/Gemma-4-26B-A4B-It-Abliterated-GGUF

Image-Text-to-Text • 25B • Updated Jun 10 • 1.57k • 4

AtomicChat/gemma-4-12B-it-GGUF

Image-Text-to-Text • 12B • Updated 29 days ago • 5.04k • 6

build-small-hackathon/mafia-gemma-4-12B-it-gguf

Text Generation • 12B • Updated Jun 15 • 204 • 1

michaelw9999/Qwen3.6-35B-A3B-NVFP4-MTP-GGUF

Text Generation • 36B • Updated Jun 12 • 255k • 10

SummonGovernance/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-NVFP4-MTP-GGUF

Text Generation • 27B • Updated Jun 13 • 1.44k • 5

Frosty40/Nex-N2-mini-Turbo-Phase-Twin

Text Generation • 67B • Updated Jun 20 • 116 • 5

VibeManGeo/Zen-5-Coder-GGUF

80B • Updated Jun 17 • 206 • 1

LiquidAI/LFM2.5-Embedding-350M-GGUF

Sentence Similarity • 0.4B • Updated Jun 22 • 3.47k • 38

AtomicChat/Qwen3.5-4B-GGUF

Text Generation • 4B • Updated about 1 month ago • 17.7k • 1

ibm-granite/granite-vision-4.1-4b-GGUF

3B • Updated Jun 24 • 2.12k • 8

armand0e/Qwen3.5-9B-Fable-5-SDFT-GGUF

Text Generation • 9B • Updated Jun 20 • 459 • 6

WaveCut/Qwen3.6-35B-A3B-REAM-160-ru-agent-GGUF

23B • Updated Jun 21 • 1.24k • 10