Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,496

Base only

Active filters: imatrix

ruv/ruvltra-small

Text Generation • 0.5B • Updated Mar 28 • 311 • 1

mradermacher/GutenOCR-7B-i1-GGUF

3B • Updated Jul 16 • 551 • 1

mradermacher/ToolMind-web-3B-i1-GGUF

4B • Updated Jan 29 • 302 • 1

mradermacher/Gemma-3-4B-VL-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking-i1-GGUF

4B • Updated Feb 2 • 433 • 2

bartowski/moonshotai_Kimi-Linear-48B-A3B-Instruct-GGUF

Text Generation • 49B • Updated Feb 9 • 13.7k • 24

ubergarm/Step-3.5-Flash-GGUF

Text Generation • 197B • Updated Feb 16 • 94 • 44

Ex0bit/Step-3.5-Flash-PRISM

Text Generation • 197B • Updated Feb 12 • 275 • 19

DFveloper/Spotwrite-1-gguf

24B • Updated Feb 8 • 273 • 3

bartowski/huihui-ai_Qwen3-Coder-Next-abliterated-GGUF

Text Generation • 80B • Updated Feb 10 • 76.4k • 32

unsloth/MiniMax-M2.5-GGUF

Text Generation • 229B • Updated Feb 14 • 7.24k • 246

mradermacher/Qwen3-30B-A3B-Claude-4.5-Opus-High-Reasoning-2507-ABLITERATED-UNCENSORED-V2-i1-GGUF

31B • Updated Feb 16 • 3.21k • 5

mradermacher/Qwen3-Next-80B-A3B-Thinking-GRPO-Uncensored-i1-GGUF

80B • Updated 4 days ago • 22.6k • 3

unsloth/Qwen3.5-35B-A3B-GGUF

Image-Text-to-Text • 35B • Updated Mar 5 • 162k • 861

unsloth/Qwen3.5-27B-GGUF

Image-Text-to-Text • 27B • Updated Mar 5 • 234k • 502

mradermacher/Qwen3.5-35B-A3B-heretic-i1-GGUF

35B • Updated Feb 27 • 483 • 14

mradermacher/zen3-vl-i1-GGUF

Image-Text-to-Text • 8B • Updated 27 days ago • 474 • 1

dinerburger/Qwen3.5-27B-GGUF

27B • Updated Jun 19 • 386 • 6

Ex0bit/Qwen3.5-122B-A10B-PRISM-PRO-GGUF

Image-Text-to-Text • 122B • Updated Mar 2 • 428 • 27

mradermacher/zen-vl-8b-agent-i1-GGUF

Image-Text-to-Text • 8B • Updated 25 days ago • 840 • 1

mradermacher/zen-vl-8b-instruct-i1-GGUF

Image-Text-to-Text • 8B • Updated 25 days ago • 447 • 1

mradermacher/Huihui-Qwen3.5-9B-abliterated-i1-GGUF

9B • Updated Mar 10 • 2.44k • 12

mradermacher/Qwen3-30B-A3B-Instruct-2507-REAM-heretic-i1-GGUF

23B • Updated Mar 15 • 274 • 1

unsloth/Mistral-Small-4-119B-2603-GGUF

119B • Updated Apr 20 • 21.9k • 83

darkc0de/XortronCriminalComputingConfig-i1-GGUF

24B • Updated Mar 17 • 1.15k • 8

mradermacher/Step-3.5-Flash-REAP-121B-A11B-i1-GGUF

121B • Updated Mar 21 • 1.06k • 6

mradermacher/Qwen3.5-Queen-27B-i1-GGUF

Image-Text-to-Text • 27B • Updated Mar 20 • 3.66k • 3

ENOSYS/Qwen3.5-0.8B-heretic-250-v1-GGUF

Image-Text-to-Text • 0.8B • Updated Mar 30 • 88 • 2

cahlen/qwen3.5-35b-a3b-compacted-GGUF

23B • Updated Mar 28 • 5.15k • 2

mradermacher/Huihui-Qwopus3.5-9B-v3-abliterated-i1-GGUF

9B • Updated Apr 5 • 377 • 6

batiai/Gemma-4-26B-A4B-it-GGUF

Text Generation • 25B • Updated May 4 • 741 • 3