Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,089

Base only

Active filters: llama-cpp

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated 10 days ago • 41.4k • 57

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 13 days ago • 15.8k • 72

autotrust/gpt-oss-120b-Fable-5-Distilled-GGUF

Text Generation • 117B • Updated 4 days ago • 1.64k • 14

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 17.2k • 727

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 9 days ago • 8.85k • 9

prithivMLmods/lift-GGUF

Image-Text-to-Text • 9B • Updated 7 days ago • 4.57k • 5

wepiqx/Qwythos-9B-Claude-Mythos-5-1M-SHQ8-GGUF

Text Generation • 9B • Updated 3 days ago • 485 • 6

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 10.9k • 314

spiritbuun/buun-Qwen3.6-chat_template

Updated 29 days ago • 52

prithivMLmods/VibeThinker-3B-heretic_decensored-GGUF

Text Generation • 3B • Updated 6 days ago • 1.39k • 4

wepiqx/Qwable-9B-Claude-Fable-5-SHQ8-GGUF

Text Generation • 9B • Updated 3 days ago • 708 • 4

wepiqx/Qwythos-9B-Claude-Mythos-5-1M-MTP-SHQ8-GGUF

Text Generation • 9B • Updated 3 days ago • 1.27k • 4

gaoqianshen/Qwen-AgentWorld-35B-A3B-Q4_K_M-GGUF

Text Generation • 35B • Updated 2 days ago • 3.38k • 4

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 6k • 23

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 27k • 44

oussaber/VibeThinker-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated 10 days ago • 3.92k • 9

JohnRoger/VibeThinker-3B-Q8_0-GGUF

Text Generation • 3B • Updated 10 days ago • 1.94k • 6

prithivMLmods/ultragemma4-12b-heretic-uncensored

Image-Text-to-Text • 12B • Updated about 4 hours ago • 1.95k • 3

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 993 • 5

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 593 • 243

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 161 • 45

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 18 days ago • 22.6k • 25

jinaai/jina-embeddings-v5-text-nano-retrieval-GGUF

Sentence Similarity • 0.2B • Updated Feb 27 • 2.54k • 3

WithinUsAI/IBM-Grok4-Ultra.Fast.Coder-1B-GGUF

Text Generation • 2B • Updated Mar 30 • 825 • 4

0xSero/GLM-5.1-555B-GGUF

Text Generation • 563B • Updated 27 days ago • 176 • 7

Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-GGUF

Text Generation • 35B • Updated Apr 16 • 17.8k • 30

AtomicChat/Qwen3.6-35B-A3B-UDT-MTP-GGUF

36B • Updated May 13 • 3.53k • 9

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated 11 days ago • 2.89k • 11

mitkox/FastContext-1.0-4B-RL-Q8_0-GGUF

4B • Updated 11 days ago • 404 • 3

prithivMLmods/ultragemma4-e4b-heretic-uncensored

Image-Text-to-Text • 7B • Updated about 4 hours ago • 1.11k • 2