Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,942

Base only

Active filters: llama.cpp

JesusAura999/Senik-3B-V1-GGUF

3B • Updated Jan 20 • 10

ukung/qwen3-4B-finetune-sintesis-dataset

4B • Updated Jan 20 • 9

JesusAura999/Senik-3B-Thinker-GGUF

3B • Updated Jan 20 • 20

AfkaraLP/gemma-3-270M-coralmc-9500it-v06

0.3B • Updated Jan 20 • 6

ngocquy2004/Qwen3-4B-Instruct-FineTuned-GGUF

4B • Updated Apr 19 • 8

chukypedro/Niajalingo-Qwen2.5-0.5B-GGUF

0.5B • Updated Jan 20 • 45

VijayRam1812/gemma3-1b-query-optimizer

1.0B • Updated Jan 21 • 23

terasut/typhoon-si-med-thinking-4b-research-preview-GGUF

Text Generation • 4B • Updated Jan 21 • 22

VishwanathAS/Qwen3-VL-Driver-GGUF_v2

2B • Updated Jan 21 • 9

sunkencity/survival-expert-qwen-32b-gguf

33B • Updated Jan 21 • 71

mradermacher/Pegon-AI-VL-GGUF

2B • Updated Feb 24 • 22

nihardon/fine-tuned-unit-test-generator

8B • Updated Jan 21 • 9

Umesh1212/functiongemma-finetune-tool-call

0.3B • Updated Jan 21 • 21

pelinbalci/my-qwen-finetuned-gguf

0.5B • Updated Feb 10 • 28

AfkaraLP/gemma-3-270M-coralmc-9500it-v07

0.3B • Updated Jan 21 • 7

beyond-logic-labs/Llama-3.1-8B-Instruct-GGUF

8B • Updated Jan 21 • 7

AfkaraLP/gemma-3-270M-coralmc-8500it-v08

0.3B • Updated Jan 21 • 7

akbasal22/gemma-finetune-gguf-mental

3B • Updated Jan 21 • 5

GhostScientist/gpt-oss-20b-semanticwiki-gguf

21B • Updated Jan 22 • 24 • 1

kimjyun/RPA-Qwen2.5-0.5B

0.5B • Updated Jan 22 • 10

shemilk/gemma-3-4b-finetune-gguf-en-ml

4B • Updated Jan 22 • 3

prithivMLmods/ChartVerse-2B-GGUF

Image-Text-to-Text • 2B • Updated Jan 23 • 472 • 2

rizkysulaeman/Function-Gemma-270M-Q8_0

0.3B • Updated Jan 22 • 16

kimjyun/RPA-Qwen2.5-0.5B-V2

0.5B • Updated Jan 22 • 9

rizkysulaeman/Function-Gemma-270M-BF16

0.3B • Updated Jan 22 • 13

rizkysulaeman/Function-Gemma-270M-F16

0.3B • Updated Jan 22 • 6

Ciphrox/lumi

8B • Updated Jan 22 • 9

soupai/echo-uncensoredd

8B • Updated Jan 22 • 32 • 1

wangjazz/LightOnOCR-2-1B-gguf

Image-Text-to-Text • 0.6B • Updated Jan 23 • 533 • 4

kimcomehome/Llama-3-ELI5-GGUF

8B • Updated Jan 22 • 7