Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,311

Base only

Active filters: llama.cpp

lilyanatia/Bonsai-1.7B-requantized

2B • Updated Apr 27 • 144 • 6

lilyanatia/Bonsai-4B-requantized

4B • Updated Apr 27 • 107 • 4

prithivMLmods/gemma-4-26B-A4B-it-F32-GGUF

Image-Text-to-Text • 25B • Updated Apr 3 • 2.81k • 5

TeichAI/gemma-4-31B-it-Claude-Opus-Distill-GGUF

31B • Updated May 8 • 4.98k • 73

kai-os/Carnice-9b-GGUF

Text Generation • 9B • Updated Apr 4 • 2.37k • 58

LiquidAI/LFM2.5-VL-450M-GGUF

Image-Text-to-Text • 0.4B • Updated Apr 6 • 6.66k • 49

DJLougen/Harmonic-9B-GGUF

9B • Updated Apr 4 • 266 • 6

daniloreddy/gemma-4-E4B-it_GGUF

Text Generation • 8B • Updated Apr 5 • 147 • 1

groxaxo/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF

Image-Text-to-Text • 25B • Updated Apr 22 • 34.8k • 24

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1-GGUF

Image-Text-to-Text • 9B • Updated Apr 18 • 72.5k • 104

DJLougen/Ornstein3.6-35B-A3B-GGUF

Image-Text-to-Text • 35B • Updated 26 days ago • 1.42k • 41

Abiray/Qwen3.6-35B-A3B-heretic-GGUF

Image-Text-to-Text • 35B • Updated Apr 17 • 1.48k • 17

YTan2000/Qwen3.6-35B-A3B-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 18 • 2.52k • 77

exdysa/MiniMax-M2.7-REAP-172B-A10B-GGUF

Text Generation • 173B • Updated Apr 27 • 752 • 9

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 20 • 6.6k • 30

zoobomb/qwen-l4d2-7b-v2-GGUF

Text Generation • 8B • Updated Apr 20 • 13 • 1

zoobomb/qwen-l4d2-14b-v2-GGUF

Text Generation • 15B • Updated Apr 20 • 5 • 1

fauzanazz/Qwen3.6-27B-Q3_K_M-GGUF

Image-Text-to-Text • 27B • Updated Apr 22 • 960 • 2

Youseff1987/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF-with-mmproj

Text Generation • 35B • Updated Apr 23 • 1.61k • 2

nphearum/Gemma-4-e2b-CodeX-Distill-v1-GGUF

Text Generation • 5B • Updated May 3 • 1.25k • 1

spiritbuun/Qwen3.6-27B-DFlash-GGUF

Updated Apr 24 • 11.9k • 70

TeichAI/Qwen3.6-27B-Claude-Opus-Reasoning-Distill-v2-GGUF

27B • Updated Apr 27 • 8.11k • 35

loilkon/Qwopus3.5-9B-v3.5-Uncensored

Text Generation • 9B • Updated Apr 25 • 704 • 8

GestaltLabs/Ornstein-Hermes-3.6-27b-GGUF

Image-Text-to-Text • 27B • Updated Apr 26 • 1.17k • 11

exdysa/MiniMax-M2.7-REAP-139B-A10B-GGUF

Text Generation • 139B • Updated Apr 29 • 350 • 1

anemll/DeepSeek-V4-Flash-FP4-FP8-SSD

Text Generation • 7B • Updated Apr 29 • 1.65k • 6

batiai/Mistral-Medium-3.5-128B-GGUF

Text Generation • 125B • Updated 3 days ago • 1.59k • 1

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_gguf

Text Generation • 21B • Updated May 2 • 1.75k • 4

freakyskittle/MiniMax-M2.75-460B-A20B-GGUF

Text Generation • 453B • Updated 14 days ago • 635 • 1

LibertAIDAI/Qwen3.6-27B-NVFP4-GGUF

Image-Text-to-Text • 27B • Updated May 4 • 5.62k • 14