Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,441

Base only

Active filters: quantization

nota-ai/Solar-Open2-250B-Nota-NVFP4-GlobalPruned

Text Generation • 117B • Updated 6 days ago • 496 • 34

nota-ai/Solar-Open2-250B-Nota-INT4-GlobalPruned

Text Generation • 35B • Updated 12 days ago • 1.23k • 43

Bruce001/gemma4-12b-ashq1-4850

Text Generation • 12B • Updated 23 days ago • 71 • 2

weili-0234/Qwen3.5-9B-MXFP4-RTN

6B • Updated 23 days ago • 37

xv0y5ncu/SmolLM3-3B-trellis-3inst-4bpw-kernel

Text Generation • 1.0B • Updated 7 days ago • 835

weili-0234/Qwen3.5-9B-MXFP4-QAD-s1000

Text Generation • 6B • Updated 21 days ago • 109

weili-0234/Qwen3.5-9B-MXFP4-QAD-s2000

Text Generation • 6B • Updated 21 days ago • 110

weili-0234/Qwen3.5-9B-MXFP4-QAD-s3000

Text Generation • 6B • Updated 21 days ago • 107

weili-0234/Qwen3.5-9B-MXFP4-QAD-s4000

Text Generation • 6B • Updated 21 days ago • 113

weili-0234/Qwen3.5-9B-MXFP4-GPTQ

6B • Updated 22 days ago • 5

weili-0234/Qwen3.5-9B-NVFP4-QAD-s1000

Text Generation • 6B • Updated 21 days ago • 113

weili-0234/Qwen3.5-9B-NVFP4-QAD-s2000

Text Generation • 6B • Updated 21 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-s3000

Text Generation • 6B • Updated 21 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-s4000

Text Generation • 6B • Updated 21 days ago

yasu-oh/gemma-4-12B-it-qat-NVFP4

Image-Text-to-Text • 12B • Updated 14 days ago • 364

rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm

Text Generation • 104B • Updated 15 days ago • 100 • 3

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s1000

Text Generation • 6B • Updated 21 days ago • 4

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s4000

Text Generation • 6B • Updated 21 days ago • 2

kachowtowmater/SuperGLM-5.2-abliterated-MXFP8-NVFP4-NF3-Hybrid

Text Generation • 347B • Updated 22 days ago • 87

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s2000

Text Generation • 6B • Updated 21 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s3000

Text Generation • 6B • Updated 21 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s4000

Text Generation • 6B • Updated 21 days ago • 6

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s1000

Text Generation • 6B • Updated 21 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s2000

Text Generation • 6B • Updated 21 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s3000

Text Generation • 6B • Updated 21 days ago • 2

fanwu103/MiMo-V2.5-Pro-MXFP4v2

Text Generation • 554B • Updated 22 days ago • 22

bogdan-radulescu/gemma-4-26B-A4B-it-asym-GGUF

Text Generation • 27B • Updated 22 days ago • 215

bogdan-radulescu/qwen3.6-35B-A3B-asym-GGUF

Text Generation • 35B • Updated 22 days ago • 160

guideboardlabs/Nanbeige4.2-3B-GGUF

4B • Updated 21 days ago • 873 • 2

vxltxrllc/Qwen3-32B-BA-GGUF

33B • Updated 21 days ago • 116 • 1