Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,395

Base only

Active filters: quantization

elrashid/gate-gemma-2-9b-it-l21

elrashid/gate-gemma-3-1b-it-l13

elrashid/gate-gemma-3-4b-it-l17

elrashid/gate-gemma-4-e2b-it-l17

elrashid/gate-gemma-4-e4b-it-l21

elrashid/gate-llama-3.1-8b-instruct-l16

elrashid/gate-phi-4-mini-instruct-l16

theLittleStone/Qwen3.6-27B-AEON-Ultimate-Uncensored-MTP-GGUF

Text Generation • 27B • Updated Jul 5 • 444 • 1

Danny-Dasilva/gemma-4-12B-it-W4A16-GPTQ-g32-DSpark

Text Generation • 12B • Updated Jul 4 • 331

madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid

318B • Updated Jul 28 • 120 • 70

Helllbos/Qwen3-8B-INT8

Text Generation • 8B • Updated Jul 9 • 24 • 1

maczzinatui/Qwen3.6-27B-MTP-ROCmFP4_FAST-GGUF

27B • Updated Jul 11 • 45

maczzinatui/Grug-12B-ROCmFP4_FAST-GGUF

12B • Updated Jul 11 • 41

yasu-oh/gemma-4-31B-it-qat-NVFP4

Image-Text-to-Text • 18B • Updated Aug 21 • 117 • 1

maczzinatui/Qwen3.6-27B-MTP-TQ3_4S-GGUF

27B • Updated Jul 11 • 54

realrebelai/SeFi-Image-5B-Base

5B • Updated Jul 6 • 66 • 4

realrebelai/SeFi-Image-5B-Turbo

5B • Updated Jul 6 • 382 • 7

chfm/Boogu-Image-Edit-Turbo_GGUFs

10B • Updated Jul 6 • 131

nota-ai/Qwen3.5-4B-QAD-W4A16

Text Generation • 5B • Updated Jul 6 • 1.47k • 3

nerkyor/Step-3.7-Flash-180B-LynnStyle-GLM52-SFT-GPT55-RL-GGUF

Text Generation • 181B • Updated Jul 7 • 332 • 3

jmarquex/nexusquant

nerkyor/Step-3.7-Flash-180B-LynnStyle-GLM52-SFT-GPT55-RL

Text Generation • 139B • Updated Jul 7 • 305 • 1

pablohassan/Qwen3.6-27B-NVFP4-FR

Text Generation • 19B • Updated Jul 14 • 70 • 1

lhs101/wint4-quantized-models

aquaman164/GLM-5.2-VQ-1.9bit

Text Generation • 50B • Updated Jul 8 • 14

realrebelai/NL-Diffusion-Image_GGUF

10B • Updated Jul 9 • 475 • 1

Danny-Dasilva/Qwen3-4B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 4B • Updated Jul 7 • 34

sakamakismile/ThinkingCap-Qwen3.6-27B-NVFP4

Image-Text-to-Text • 17B • Updated Jul 8 • 359 • 21

Danny-Dasilva/Qwen3-8B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 8B • Updated Jul 8 • 66 • 1

SC117/Qwen-AgentWorld-35B-A3B-MTP-Uncensored-APEX-GGUF

Text Generation • 0.4B • Updated 5 days ago • 2.23k • 13