Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,324

Base only

Active filters: llama.cpp

EMD123/tiny-aya-kosher-3.3B-GGUF

3B • Updated Mar 17 • 42 • 1

JackBinary/Qwen-3.5-10B-Frankenmerge-Opus-4.6-Distill-GGUF

10B • Updated Mar 19 • 52

duoqdo/qwen3.5-0.8b-medical-vi-gguf

0.8B • Updated Mar 17 • 37

iamdyeus/qwendean-4b-GGUF

4B • Updated Mar 19 • 127 • 2

BenjaminHelle/LFM2.5-1.2B-Code

1B • Updated Mar 17 • 48

Weidows/Qwen3.5-4B-LaTeX

Image-Text-to-Text • 5B • Updated Mar 18 • 67

slyfox1186/qwen3.5-9b-opus-4.6-functiongemma.gguf

Text Generation • 9B • Updated Mar 17 • 94 • 2

nuofang/Huihui-Qwen3.5-9B-abliterated-Grimoire-SFT-GGUF

9B • Updated Mar 18 • 7

SakaiSec/Qwen3.5-2B-Multilingual-Thinking-GGUF

2B • Updated Mar 18 • 29

nuofang/Huihui-Qwen3.5-9B-abliterated-Grimoire-ORPO-GGUF

9B • Updated Mar 18 • 10

rexooos/hextrace-sec8b-v1-GGUF

8B • Updated Mar 18 • 1

nuofang/Qwen3.5-9B-Claude-4.6-Opus-Deckard-V4.2-Uncensored-Heretic-Thinking-GGUF

9B • Updated Mar 21 • 204 • 1

NotSky/htsl-expert-7B-GGUF

8B • Updated Mar 18 • 4

alphakek/qwen35-9b-heretic-epstein-gguf

Text Generation • 9B • Updated Mar 24 • 15

Nicoesp/qwen2.5-3b-ita-logic

3B • Updated Mar 18 • 28

mradermacher/Qwen3.5-4B-LaTeX-GGUF

4B • Updated Mar 18 • 169

rexooos/hextrace-sec8b-v2-GGUF

8B • Updated Mar 18 • 8

mradermacher/Qwen3.5-4B-LaTeX-i1-GGUF

4B • Updated Mar 18 • 433

armand0e/OmniCoder-9B-Claude-Opus-High-Reasoning-Distill-GGUF

Image-Text-to-Text • 9B • Updated Mar 29 • 507 • 7

kishore601/trading-mentor-llama3-GGUF

3B • Updated Mar 18 • 180

jc-builds/Qwen3.5-9B-VLM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Mar 18 • 6.46k • 8

julien-c/Qwen3.5-4B-uncensored-GGUF

4B • Updated Mar 18 • 747 • 2

Phora68/dr-sage-qwen2.5-3b-GGUF

3B • Updated Mar 19 • 32

abhikapoor909/JeevanAI-1B-GGUF

1B • Updated Mar 18 • 6

uberkie/qwen_finetune

4B • Updated Mar 18 • 3

mabdelga/qwen3-home-assistant-gguf

2B • Updated Mar 19 • 95

dahara1/Qwen3.5-4B-UD-japanese-imatrix

4B • Updated Apr 9 • 1.07k • 6

Terisara/PAD_Student_and_teacher

3B • Updated Mar 19 • 11

bjivanovich/Qwen3.5-9B-Vision-GGUF

9B • Updated Mar 19 • 482

servus-dei/passo_gemma_3n_finetune_Q8_0

7B • Updated Mar 19 • 35 • 1