Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,443

Base only

Active filters: quantization

theLittleStone/Qwen3.6-27B-AEON-Ultimate-Uncensored-MTP-i1-GGUF

Text Generation • 27B • Updated Jul 6 • 1.88k • 2

elrashid/gate-qwen2.5-1.5b-instruct-l14

elrashid/gate-qwen2.5-7b-instruct-l14

elrashid/gate-qwen3-8b-l18

elrashid/gate-gemma-2-2b-it-l13

elrashid/gate-gemma-2-9b-it-l21

elrashid/gate-gemma-3-1b-it-l13

elrashid/gate-gemma-3-4b-it-l17

elrashid/gate-gemma-4-e2b-it-l17

elrashid/gate-gemma-4-e4b-it-l21

elrashid/gate-llama-3.1-8b-instruct-l16

elrashid/gate-phi-4-mini-instruct-l16

theLittleStone/Qwen3.6-27B-AEON-Ultimate-Uncensored-MTP-GGUF

Text Generation • 27B • Updated Jul 5 • 13.6k

Danny-Dasilva/gemma-4-12B-it-W4A16-GPTQ-g32-DSpark

Text Generation • 12B • Updated Jul 4 • 885

madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid

318B • Updated 16 days ago • 2.54k • 68

Helllbos/Qwen3-8B-INT8

Text Generation • 8B • Updated Jul 9 • 124 • 1

maczzinatui/Qwen3.6-27B-MTP-ROCmFP4_FAST-GGUF

27B • Updated Jul 11 • 2.35k

maczzinatui/Grug-12B-ROCmFP4_FAST-GGUF

12B • Updated Jul 11 • 67

yasu-oh/gemma-4-31B-it-qat-NVFP4

Image-Text-to-Text • 18B • Updated 14 days ago • 620 • 1

maczzinatui/Qwen3.6-27B-MTP-TQ3_4S-GGUF

27B • Updated Jul 11 • 2.66k

realrebelai/SeFi-Image-5B-Base

5B • Updated Jul 6 • 317 • 4

realrebelai/SeFi-Image-5B-Turbo

5B • Updated Jul 6 • 1.07k • 6

chfm/Boogu-Image-Edit-Turbo_GGUFs

10B • Updated Jul 6 • 259

nota-ai/Qwen3.5-4B-QAD-W4A16

Text Generation • 5B • Updated Jul 6 • 487 • 2

nerkyor/Step-3.7-Flash-180B-LynnStyle-GLM52-SFT-GPT55-RL-GGUF

Text Generation • 181B • Updated Jul 7 • 5.09k • 3

jmarquex/nexusquant

Updated 27 days ago

nerkyor/Step-3.7-Flash-180B-LynnStyle-GLM52-SFT-GPT55-RL

Text Generation • 139B • Updated Jul 7 • 1.2k • 1

pablohassan/Qwen3.6-27B-NVFP4-FR

Text Generation • 19B • Updated 30 days ago • 1.2k • 1

lhs101/wint4-quantized-models

aquaman164/GLM-5.2-VQ-1.9bit

Text Generation • 50B • Updated Jul 8 • 35