Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,844

Base only

Active filters: llama.cpp

philtheriver/Qwen3.6-27B-ROCmFPX

Text Generation • 27B • Updated Jun 23 • 752 • 5

christopher-kapic/AEON-Ultimate-ROCmFP4-Strix-Halo-GGUF

27B • Updated Jun 26 • 325 • 3

jcbtc/Qwable-5-27B-Chadrock-v2-ROCmFP6-QUALITY

Text Generation • 27B • Updated Jun 25 • 85 • 2

Jiunsong/SuperGemma-4-12b-abliterated-gguf-4bit

Text Generation • 12B • Updated Jun 25 • 1.25k • 12

Coding123defy/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Text Generation • 9B • Updated Jun 25 • 519 • 1

AtomicChat/Ornith-9B-GGUF

Text Generation • 9B • Updated about 1 month ago • 3.04k • 15

nerkyor/Qwen3.6-27B-DSV4Pro-Thinking-Distill-GGUF

Text Generation • 0.5B • Updated Jun 28 • 3.82k • 7

nerkyor/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-GGUF

Text Generation • 0.4B • Updated Jun 28 • 3.9k • 10

sanjxz/Qwen-Fixed-Chat-Templates

Updated Jul 22 • 6

williamliao/Qwen3.6-35B-A3B-DFlash-GGUF

Text Generation • 0.4B • Updated Jul 13 • 793 • 4

oracomputing/OraQwen3-Omni-20B-A3B-Instruct-GGUF

Any-to-Any • 20B • Updated Jul 1 • 1

williamliao/Qwen3.6-35B-A3B-NVFP4-GGUF

Text Generation • 36B • Updated Jul 13 • 696 • 4

ibm-granite/granite-speech-4.1-2b-plus-GGUF

2B • Updated Jun 30 • 810 • 3

GoAutomateAI/terna-e2b-GGUF

Text Generation • 5B • Updated Jul 1 • 26 • 1

AtomicChat/Laguna-XS-2.1-GGUF

Text Generation • 33B • Updated about 1 month ago • 7.03k • 14

satgeze/Ornith-1.0-35B-1M-GGUF

Text Generation • 0.4B • Updated Jul 16 • 2.56k • 9

neko-legends/Qwen3.6-27B-NVFP4-MTP-GGUF

Text Generation • 27B • Updated Jul 20 • 3k • 5

satgeze/Ornith-1.0-9B-1M-GGUF

Text Generation • 0.5B • Updated Jul 16 • 1.69k • 9

satgeze/Ornith-1.0-397B-1M-GGUF

Text Generation • Updated Jul 10 • 3

King3Djbl/nexus-science-GGUF

Text Generation • 2B • Updated Jul 17 • 1.65k • 4

satgeze/Gemma4-26B-A4B-Uncensored-HauhauCS-1M-GGUF

Text Generation • 25B • Updated Jul 10 • 3.81k • 5

jamiefutch/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M

Text Generation • 39B • Updated Jul 6 • 194 • 1

satgeze/Gemma4-12B-Uncensored-HauhauCS-1.5M-GGUF

Text Generation • 12B • Updated Jul 10 • 1.26k • 4

canyrtcn/Gemma_E4B_Kizagan_Abliterated-GGUF

Text Generation • 8B • Updated Jul 7 • 58 • 3

Brian6145/Qwen3.6-27B-Claude-Opus-DeepSeek-Distilled-Imatrix-MTP-1M-GGUF

Text Generation • 27B • Updated Jul 12 • 8.91k • 5

BenjaminHelle/LFM2.5-350M-coder

Text Generation • 0.4B • Updated 16 days ago • 349 • 1

xCloudinfo/xGemable-12B-coder-v1.5-GGUF

Text Generation • 12B • Updated Jul 15 • 118k • 1

liodon-ai/Qwen2.5-3B-imatrix-GGUF

Text Generation • 3B • Updated Jul 13 • 112 • 1

AlexanderKyng/Agents-A1-Q8-Plus

Image-Text-to-Text • 35B • Updated Jul 14 • 74 • 1

Pluto-AI-Labs/Pluto-Genesis-0.6B-GGUF

Text Generation • 0.6B • Updated Jul 15 • 167 • 1