Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,410

Base only

Active filters: llama.cpp

VishwanathAS/Qwen2.5-VLA_Drive-GGUF

3B • Updated Jan 20 • 30

Sudharta/sudharta-experiment

3B • Updated Jan 20 • 4

developerasaad/Qwen3-0.6B

0.8B • Updated Jan 20 • 10

Mathieu-Thomas-JOSSET/qwen2.5-3b-instruct-text-gguf-20260120_095909

3B • Updated Jan 20 • 8

Mathieu-Thomas-JOSSET/qwen2.5-3b-instruct-text-gguf-20260120_111441

3B • Updated Jan 20 • 4

MuXodious/GLM-4.7-Flash-impotent-heresy-GGUF

Text Generation • 30B • Updated Jan 28 • 45 • 1

jsdevtom/qwen2.5-coder-7b-ts-fim-autocomplete-defuss-gguf

8B • Updated Jan 20 • 1.08k

MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF

Image-Text-to-Text • 7B • Updated Jan 20 • 115

VishwanathAS/Qwen3-VL-Driver-GGUF

2B • Updated Jan 20 • 8

Soumyajit2000/bucktlist-agent-gguf

4B • Updated Feb 26 • 15

viplav0009/chandler-bing-3.2-1B-gguf

1B • Updated Jan 20 • 3

JesusAura999/Senik-3B-V1-GGUF

3B • Updated Jan 20 • 9

ukung/qwen3-4B-finetune-sintesis-dataset

4B • Updated Jan 20 • 5

JesusAura999/Senik-3B-Thinker-GGUF

3B • Updated Jan 20 • 10

AfkaraLP/gemma-3-270M-coralmc-9500it-v06

0.3B • Updated Jan 20 • 1

ngocquy2004/Qwen3-4B-Instruct-FineTuned-GGUF

4B • Updated Apr 19 • 16

chukypedro/Niajalingo-Qwen2.5-0.5B-GGUF

0.5B • Updated Jan 20 • 21

VijayRam1812/gemma3-1b-query-optimizer

1.0B • Updated Jan 21 • 15

terasut/typhoon-si-med-thinking-4b-research-preview-GGUF

Text Generation • 4B • Updated Jan 21 • 22

VishwanathAS/Qwen3-VL-Driver-GGUF_v2

2B • Updated Jan 21 • 3

sunkencity/survival-expert-qwen-32b-gguf

33B • Updated Jan 21 • 21

mradermacher/Pegon-AI-VL-GGUF

2B • Updated Feb 24 • 4

nihardon/fine-tuned-unit-test-generator

8B • Updated Jan 21 • 6

Umesh1212/functiongemma-finetune-tool-call

0.3B • Updated Jan 21 • 1

pelinbalci/my-qwen-finetuned-gguf

0.5B • Updated Feb 10 • 25

AfkaraLP/gemma-3-270M-coralmc-9500it-v07

0.3B • Updated Jan 21 • 4

beyond-logic-labs/Llama-3.1-8B-Instruct-GGUF

8B • Updated Jan 21 • 6

AfkaraLP/gemma-3-270M-coralmc-8500it-v08

0.3B • Updated Jan 21 • 8

akbasal22/gemma-finetune-gguf-mental

3B • Updated Jan 21 • 2

GhostScientist/gpt-oss-20b-semanticwiki-gguf

21B • Updated Jan 22 • 42 • 1