Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

11,988

Base only

Active filters: llama.cpp

marksverdhei/LCO-Embedding-Omni-3B-2605-GGUF

Feature Extraction • 3B • Updated May 16 • 160 • 5

AbteeXAILab/lumynax-coder-codellama-70b-instruct-gguf

Text Generation • 69B • Updated Sep 3 • 89 • 2

OBLITERATUS/Qwen3.6-27B-OBLITERATED

Text Generation • 27B • Updated May 23 • 4.27k • 199

HuggingFaceBio/Carbon-8B-GGUF

8B • Updated Jun 2 • 222k • 12

armand0e/Qwen3.5-9B-Opus-Agent-GGUF

9B • Updated May 26 • 359 • 9

Jackrong/Qwopus3.6-27B-v2-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 9 • 80.7k • 393

LiquidAI/LFM2.5-1.2B-JP-202606-GGUF

Text Generation • 1B • Updated Sep 11 • 3.26k • 28

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 162k • 145

LiquidAI/LFM2.5-Audio-1.5B-JP-GGUF

Audio-to-Audio • 1B • Updated Sep 11 • 104k • 34

stepfun-ai/Step-3.7-Flash-GGUF

Image-Text-to-Text • 197B • Updated Jun 3 • 4.76k • 174

vrfai/gr00tn1d7-libero-gguf

Robotics • Updated Jun 3 • 159 • 1

younissk/nanoBeard-frigate-360M-GGUF

Text Generation • 0.4B • Updated Jun 1 • 94 • 6

Surpem/Supertron-2.1-8B-A1B-GGUF

Text Generation • 8B • Updated Jun 1 • 876 • 6

JetBrains/Mellum2-12B-A2.5B-Thinking-GGUF-Q8_0

Text Generation • 12B • Updated Jun 4 • 496 • 23

jcbtc/CHADROCK3.6-35B-UNCENSORED-MTP-STRIX-LEAN

Text Generation • 36B • Updated Jun 23 • 665 • 12

superbonyx/gemma-4-26B-A4B-it-qat-assistant-MTP-Q8_0.gguf

Text Generation • 0.4B • Updated Jun 8 • 311 • 3

Tivaphraen/LFM2.5-8B-A1B-Opus-Distil-GGUF

Text Generation • 8B • Updated Jun 11 • 531 • 2

preferedev/Roblox-Coder-v2_gguf

4B • Updated Jun 11 • 1.55k • 4

FINAL-Bench/Darwin-28B-Coder-GGUF

Text Generation • 27B • Updated Jul 25 • 155 • 39

eldinosaur/cuentas-claras-sat-classifier-gguf

8B • Updated Jun 14 • 13 • 1

tvall43/Qwen3.6-14B-A3B-FableVibes-GGUF

Text Generation • 14B • Updated Jun 15 • 335k • 199

AtomicChat/Qwen3-Coder-30B-A3B-GGUF

Text Generation • 31B • Updated Jul 22 • 6.07k • 4

AtomicChat/Qwen3.6-27B-GGUF

Text Generation • 27B • Updated Jul 22 • 3.56k • 1

vrfai/pi05-libero-gguf

Robotics • 3B • Updated Aug 5 • 625 • 4

DennisHuang648/VoxCPM2-GGUF

Text-to-Speech • 0.9B • Updated Jun 30 • 15.8k • 15

FunAudioLLM/SenseVoiceSmall-GGUF

Automatic Speech Recognition • 0.2B • Updated Jun 21 • 4.65k • 16

FunAudioLLM/Fun-ASR-Nano-GGUF

Automatic Speech Recognition • 0.2B • Updated Jul 26 • 8.16k • 6

Qapdex/SLM-ATP-Hybrid-Projector

Any-to-Any • Updated Jun 28 • 1

Abiray/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF

Text Generation • 9B • Updated Jun 26 • 1.4k • 10

Alittlehammmer/gemma-4-31B-it-DFlash-GGUF-llama.cpp

Text Generation • 2B • Updated Jun 29 • 420 • 3