Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

12,068

Base only

Active filters: llama.cpp

asianaaibigdata/llama3.2-orpo-gguf

3B • Updated Jan 7 • 43

meetara-lab/meetara-phi-3.5-mini-instruct-gguf

4B • Updated Mar 7 • 17

bigatuna/NousCoder-14B-GGUF

15B • Updated Jan 8 • 41 • 10

meetara-lab/meetara-qwen2.5-1.5b-instruct-gguf

2B • Updated Mar 7 • 22

meetara-lab/meetara-qwen2.5-3b-instruct-gguf

3B • Updated Mar 7 • 16

Tristepin/qzdqwn34b-ins1

4B • Updated Jan 7 • 21

meetara-lab/meetara-qwen2.5-7b-instruct-gguf

8B • Updated Mar 7 • 31

vedanshsingh17/gemma-finetune-2b-it-gguf

3B • Updated Jan 7 • 14

Tristepin/qzdqwn34b-ins2

4B • Updated Jan 7 • 18

vedanshsingh17/gemma-finetune-2b-it-gguf-bf16

3B • Updated Jan 7 • 18

vedanshsingh17/gemma-finetune-2b-it-gguf-v2

3B • Updated Jan 7 • 14

JohnsonPedia/qwen-3-3b-yoruba-chat-gguf

3B • Updated Jan 7 • 44

vedanshsingh17/gemma-finetune-2b-it-gguf-v3

3B • Updated Jan 7 • 10

kiritzzo1612/Aurora_GGUF_Final

9B • Updated Jan 7 • 12

Avarok/IQuest-Coder-V1-40B-Loop-Instruct-GGUF

Text Generation • Updated Jan 7 • 1

Christoferson/gemma3-270m-sft-basic-lora64-V2-20260107-200054-GGUF

0.3B • Updated Jan 7 • 35

Mathieu-Thomas-JOSSET/joke-finetome-model-gguf-phi4-20260107-235201

Text Generation • 15B • Updated Jan 7 • 37

WarlordHermes/TEST-Magidonia-24B-v4.3-creative-ORPO-v5-GGUF

24B • Updated Jan 7 • 28

Christoferson/qwen2.5-500M-grpo-after-sft-both-basic-3000-3e-5-V2-20260107-193109-GGUF

0.5B • Updated Jan 8 • 39

hybridfree/neuro-symbolic-gpt-oss-20b-gguf

21B • Updated Jan 9 • 34

Sibgat-Ul/spark_tts_qk8

0.5B • Updated Jan 8 • 52

Mathieu-Thomas-JOSSET/joke-finetome-model-gguf-phi4-20260108-044416

Text Generation • 15B • Updated Jan 8 • 39

Tristepin/gd3675qwn34b-ins1

4B • Updated Jan 8 • 19

nanbeili/fortunetelling

8B • Updated Jan 8 • 16

dreambleumer/chaoyang-Qwen2.5-1.5B-Instruct-1000s-00456

2B • Updated Jan 8 • 16

joaocarloscruz/Qwen3-4B-China-Uncensored-DPO

4B • Updated Jan 8 • 53 • 1

shemilk/llamamodel

8B • Updated Jan 8 • 18

ddods/functiongemma-270m-toolthinking-gguf

0.3B • Updated Jan 8 • 15

Krishkanth/krish-mind-gguf-standalone-16

Text Generation • 8B • Updated Apr 4 • 20

shouryacoded/gemma-3-compliancely-summarizer-q4-k-m-gguf

4B • Updated Jan 8 • 29