Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,070

Base only

Active filters: llama-cpp

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated 9 days ago • 37.2k • 56

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 12 days ago • 14.4k • 70

autotrust/gpt-oss-120b-Fable-5-Distilled-GGUF

Text Generation • 117B • Updated 3 days ago • 1.14k • 11

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 18k • 727

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 8 days ago • 7.55k • 8

oussaber/VibeThinker-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated 9 days ago • 3.75k • 9

prithivMLmods/lift-GGUF

Image-Text-to-Text • 9B • Updated 6 days ago • 4.25k • 5

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated 10 days ago • 2.66k • 11

prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF

Text Generation • 3B • Updated 5 days ago • 1.06k • 4

wepiqx/Qwable-9B-Claude-Fable-5-SHQ8-GGUF

Text Generation • 9B • Updated 2 days ago • 530 • 4

wepiqx/Qwythos-9B-Claude-Mythos-5-1M-SHQ8-GGUF

Text Generation • 9B • Updated 2 days ago • 152 • 4

gaoqianshen/Qwen-AgentWorld-35B-A3B-Q4_K_M-GGUF

Text Generation • 35B • Updated 1 day ago • 12 • 4

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 13.7k • 313

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 25.9k • 43

spiritbuun/buun-Qwen3.6-chat_template

Updated 28 days ago • 51

mitkox/FastContext-1.0-4B-RL-Q8_0-GGUF

4B • Updated 10 days ago • 328 • 3

wepiqx/Qwythos-9B-Claude-Mythos-5-1M-MTP-SHQ8-GGUF

Text Generation • 9B • Updated 2 days ago • 349 • 3

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 899 • 5

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 566 • 243

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 164 • 45

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 16 days ago • 21.8k • 23

jinaai/jina-embeddings-v5-text-nano-retrieval-GGUF

Sentence Similarity • 0.2B • Updated Feb 27 • 2.4k • 3

WithinUsAI/IBM-Grok4-Ultra.Fast.Coder-1B-GGUF

Text Generation • 2B • Updated Mar 30 • 769 • 4

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 6.27k • 22

Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-GGUF

Text Generation • 35B • Updated Apr 16 • 15.4k • 30

mitkox/FastContext-1.0-4B-SFT-Q5_K_M-GGUF

4B • Updated 10 days ago • 559 • 5

JohnRoger/VibeThinker-3B-Q8_0-GGUF

Text Generation • 3B • Updated 9 days ago • 1.89k • 5

cfontes/GLM-5.2-Q4_K_M-GGUF

Text Generation • 753B • Updated 7 days ago • 2.22k • 3

Medvedko/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-Q4_K_M-GGUF

Text Generation • 12B • Updated 7 days ago • 2.54k • 2

prithivMLmods/gemma-4-E4B-it-qat-heretic_decensored-GGUF

Image-Text-to-Text • 7B • Updated 6 days ago • 1.72k • 2