Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,378

Base only

Active filters: nvfp4

lyf/Huihui-Qwen3.5-27B-abliterated-NVFP4

Image-Text-to-Text • 17B • Updated Mar 7 • 239 • 6

carlyou/DeepSeek-V2-Lite-NVFP4

Text Generation • 9B • Updated Mar 8 • 58

ppetermann/Ministral-3-8B-Instruct-2512-textonly-NVFP4

Text Generation • 5B • Updated Mar 11 • 13

ealexeev/TheDrummer-Anubis-70B-v1.2-NVFP4

41B • Updated Mar 10 • 403

ealexeev/TheDrummer-Behemoth-X-123B-v2-NVFP4

69B • Updated Mar 11 • 6

sbull-dell/Qwen3.5-27B-NVFP4

17B • Updated Mar 9 • 4

sbull-dell/Qwen3.5-35B-A3B-NVFP4

Updated Mar 9 • 14 • 1

sbull-dell/Qwen3-VL-30B-A3B-Instruct-NVFP4

16B • Updated Mar 9 • 1.24k

enfuse/Qwen2.5-72B-Instruct-NVFP4

Text Generation • 42B • Updated Mar 10 • 2.2k • 4

ItBitter/ZImageTurbo-nvfp4_mixed

Updated Mar 10 • 9

LibraxisAI/Qwen3.5-VL-122B-A10B-mlx-crk-nvfp4

Image-Text-to-Text • 31B • Updated May 11 • 83

rene98c/Qwen3.5-397B-A17B-REAP-28-NVFP4

Text Generation • Updated Mar 11 • 717 • 5

DreamFast/qwen3-4b-heretic

Text Generation • 4B • Updated 16 days ago • 18.7k • • 23

enfuse/Mixtral-8x22B-Instruct-v0.1-NVFP4

Text Generation • 79B • Updated Mar 10 • 43 • 1

berkerdooo/Qwen3.5-27B-NVFP4

Image-Text-to-Text • 17B • Updated Mar 26 • 21 • 2

mconcat/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-NVFP4

Text Generation • 22B • Updated Mar 19 • 207 • 48

lukealonso/Qwen3.5-397B-A17B-NVFP4

Text Generation • Updated Apr 12 • 1.36k • 10

enfuse/Hermes-4-405B-NVFP4

Text Generation • 230B • Updated Mar 10 • 22 • 1

drbaph/FireRed-Image-Edit-1.1_ComfyUI_Quants

Image-to-Image • Updated Mar 11 • 1.74k • 14

enfuse/Llama-xLAM-2-70b-fc-r-NVFP4

Text Generation • 41B • Updated Mar 11 • 9 • 1

tbmod/DeepSeek-V3.1-NVFP4

Text Generation • 394B • Updated Mar 11 • 16

tbmod/DeepSeek-V3.1-NVFP4-FP8KV

Text Generation • 394B • Updated Mar 11 • 14

DrQianXu/Qwen3-4B-nvfp4-Compressible

Text Generation • 3B • Updated Mar 11 • 6

nvidia/MiniMax-M2.5-NVFP4

Text Generation • 116B • Updated Apr 17 • 23.2k • 37

Winnougan/LTX-2.3-INT8

Updated Jun 27 • 21

ApacheOne/FLUX.2-klein-9b-kv-nvfp4_mixed

Updated Mar 13 • 9 • 10

lyf/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive-NVFP4

Image-Text-to-Text • 17B • Updated Apr 25 • 314 • 10

surogate/Qwen3.5-0.8B-NVFP4

Image-Text-to-Text • 0.7B • Updated Mar 16 • 12

surogate/Qwen3.5-2B-NVFP4

Image-Text-to-Text • 2B • Updated Mar 16 • 73

surogate/Qwen3.5-4B-NVFP4

Image-Text-to-Text • 3B • Updated Mar 16 • 411 • 1