Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

487

Base only

Active filters: llm-compressor

RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic

Image-Text-to-Text • 404B • Updated 23 days ago • 1.77k • 6

Sehyo/Qwen3.5-397B-A17B-NVFP4

Updated Mar 2 • 495 • 7

prithivMLmods/ZwZ-8B-FP8

Image-Text-to-Text • 9B • Updated Feb 19 • 15 • 1

prithivMLmods/chandra-FP8-Latest

Image-Text-to-Text • 9B • Updated Feb 19 • 19 • 1

RedHatAI/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Apr 28 • 108k • 34

prithivMLmods/FireRed-Image-Edit-1.0-FP8

Image-to-Image • 20B • Updated Feb 21 • 7

JongYeop/Qwen2.5-VL-3B-Instruct-FP8-W8A8-LM-Only

Image-Text-to-Text • 4B • Updated Feb 22 • 8

JongYeop/Qwen2.5-VL-3B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 3B • Updated Feb 22 • 70

JongYeop/Qwen2.5-VL-7B-Instruct-FP8-W8A8-LM-Only

Image-Text-to-Text • 8B • Updated Feb 22 • 9

JongYeop/Qwen2.5-VL-7B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Feb 22 • 6

mradermacher/chandra-FP8-Latest-GGUF

8B • Updated Feb 24 • 134

mradermacher/chandra-FP8-Latest-i1-GGUF

8B • Updated Feb 24 • 79 • 1

Sehyo/Qwen3.5-122B-A10B-NVFP4

Image-Text-to-Text • 71B • Updated Mar 2 • 50.2k • 69

Sehyo/Qwen3.5-35B-A3B-NVFP4

Updated Mar 2 • 1.02k • 41

apolo13x/Qwen3.5-35B-A3B-NVFP4

Image-Text-to-Text • Updated Feb 27 • 1.4k • 16

apolo13x/Qwen3.5-35B-A3B-quantized.w4a16

Image-Text-to-Text • 35B • Updated Feb 27 • 1.91k • 2

apolo13x/Qwen3.5-27B-NVFP4

Image-Text-to-Text • 17B • Updated Feb 27 • 2.31k • 39

apolo13x/Qwen3.5-27B-quantized.w4a16

Image-Text-to-Text • 28B • Updated Feb 27 • 2.08k • 3

inference-optimization/Qwen3-Coder-Next.w4a16

Text Generation • 12B • Updated Mar 12 • 1.06k • 1

RedHatAI/Qwen3-Coder-Next-FP8-dynamic

Text Generation • 80B • Updated Feb 27 • 762k • 2

kaitchup/Qwen3.5-27B-NVFP4

19B • Updated Feb 27 • 253 • 13

kaitchup/Qwen3.5-27B-MXFP4A16

19B • Updated Feb 27 • 12 • 3

Sehyo/Qwen3.5-27B-NVFP4

19B • Updated Mar 1 • 381 • 2

apolo13x/Qwen3.5-9B-quantized.w4a16

Image-Text-to-Text • 10B • Updated Mar 11 • 417

apolo13x/Qwen3.5-9B-NVFP4

Image-Text-to-Text • 8B • Updated Mar 11 • 1.58k • 1

RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w8a8

Text Generation • 80B • Updated Mar 3 • 63

RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic

Image-Text-to-Text • 123B • Updated Apr 28 • 1.42k • 1

inference-optimization/Qwen3-Coder-Next.w8a8

Text Generation • 80B • Updated Mar 23 • 64

JongYeop/Qwen2.5-VL-3B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 2B • Updated Mar 5 • 10

JongYeop/Qwen2.5-VL-7B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Mar 5 • 7