Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,432

Base only

Active filters: llama-cpp

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 2.39k • 64

tinh2406/full_llama2_split_merged-Q4_K_M-GGUF

7B • Updated Jun 11, 2025 • 7 • 1

liuw15/Qwen2.5-Coder-7B-Instruct-Q4_0-GGUF

8B • Updated Jul 24, 2025 • 127 • 3

enacimie/Qwen3-Embedding-0.6B-Q4_K_M-GGUF

Feature Extraction • 0.6B • Updated Sep 1, 2025 • 727 • 10

enacimie/LFM2-700M-Q4_K_M-GGUF

Text Generation • 0.7B • Updated Sep 10, 2025 • 28 • 1

ijohn07/Qwen3-14B-Uncensored-Q4_K_M-GGUF

15B • Updated Oct 6, 2025 • 1.18k • 1

wekW/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-GGUF

Text Generation • 31B • Updated Oct 13, 2025 • 627 • 1

sillykiwi/Nemotron-H-4B-Instruct-128K-Q6_K-GGUF

Text Generation • 4B • Updated Oct 27, 2025 • 67 • 1

Naruto123321/Qwen3-VL-2B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • 2B • Updated Nov 4, 2025 • 289 • 1

bocalan/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 11, 2025 • 6.75k • 10

PleIAs/Baguettotron-GGUF

0.3B • Updated Nov 19, 2025 • 547 • 13

wareef/Qwen3-VL-8B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated Nov 19, 2025 • 3.62k • 5

AliBilge/Huihui-Devstral-Small-2-24B-Instruct-2512-abliterated

Text Generation • 24B • Updated Dec 13, 2025 • 654 • 1

YOYO-AI/Qwen3-30B-A3B-YOYO-Thinking-Chimera-1M-Q4_K_M-GGUF

Text Generation • 31B • Updated Jan 5 • 48 • 1

Vali/Qwen2.5-1.5B-Instruct-abliterated-Q4_K_M-GGUF

2B • Updated Jan 11 • 1.19k • 3

intrect/VELA

Text Generation • 8B • Updated Apr 1 • 123 • 4

jinaai/jina-embeddings-v5-text-nano-retrieval

Sentence Similarity • 0.2B • Updated Apr 15 • 105k • 19

AYI-NEDJIMI/CyberSec-Assistant-3B-GGUF

Text Generation • 3B • Updated Feb 21 • 1.23k • 4

LocoreMind/LocoOperator-4B-GGUF

4B • Updated Feb 24 • 524 • 16

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated Mar 3 • 722 • 10

yybl/Gemma3-27B-it-vl-Polaris-HI16-Heretic-Uncensored-INSTRUCT-Q6_K-GGUF

Image-Text-to-Text • 27B • Updated Feb 27 • 229 • 1

forkjoin-ai/qwen2-audio-7b-instruct-gguf

Text-to-Audio • 8B • Updated Jun 9 • 783 • 6

joanlsoler/Qwen3-4b-Z-Image-Turbo-AbliteratedV1-Q4_K_M-GGUF

4B • Updated Mar 13 • 560 • 4

jc-builds/Qwen3.5-9B-VLM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Mar 18 • 6.41k • 12

AaryanK/ModelGate

Text Classification • 2B • Updated Mar 22 • 124 • 5

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 27k • 60

Gg0999vaja/venice-uncensored-Q2_K-GGUF

Text Generation • 24B • Updated Apr 4 • 308 • 2

Abiray/gemma-4-E4B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-GGUF

Text Generation • 8B • Updated Apr 8 • 1.83k • 11

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 1.14k • 4

Rustamshry/PLLuM-12B-instruct-Q8_0-GGUF

12B • Updated Apr 11 • 30 • 1