Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

442

Base only

Active filters: fp4

AlekseyCalvin/QWEN_IMAGE_fp4_w_AbliteratedTE_Diffusers

Text-to-Image • Updated Aug 6, 2025 • 34 • 9

imgailab/flux1-trtx-dev-fp4-blackwell

Updated Aug 12, 2025 • 5 • 1

imgailab/flux1-trtx-schnell-fp4-blackwell

Updated Aug 12, 2025 • 1 • 1

llmat/Mistral-7B-Instruct-v0.3-NVFP4

Text Generation • 4B • Updated Aug 27, 2025 • 182

llmat/Mistral-Small-Instruct-2409-NVFP4

Text Generation • 13B • Updated Aug 27, 2025 • 8

2imi9/gpt-oss-20B-NVFP4A16-BF16

Text Generation • 21B • Updated Dec 19, 2025 • 107 • 5

nvidia/Phi-4-multimodal-instruct-NVFP4

4B • Updated Sep 5, 2025 • 1.93k • 12

nvidia/Phi-4-reasoning-plus-NVFP4

8B • Updated Sep 5, 2025 • 667k • 11

nvidia/Qwen3-14B-NVFP4

Text Generation • 8B • Updated Sep 9, 2025 • 17.1k • 12

nvidia/Qwen3-32B-NVFP4

Text Generation • 17B • Updated Sep 9, 2025 • 259k • 17

nvidia/Qwen2.5-VL-7B-Instruct-NVFP4

Text Generation • 5B • Updated Dec 6, 2025 • 7.59k • 16

xxrjun/DeepSeek-R1-0528-FP4

394B • Updated Sep 27, 2025 • 3

Sunbird/Sunflower-14B-4bit-fp4-bnb

Text Generation • 15B • Updated Oct 9, 2025

Sunbird/Sunflower-32B-4bit-fp4-bnb

Text Generation • 33B • Updated Oct 9, 2025

RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4

Text Generation • 133B • Updated Apr 28 • 7.06k • 15

RedHatAI/Qwen3-14B-NVFP4

Text Generation • 9B • Updated Nov 21, 2025 • 4.43k • 1

RedHatAI/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Nov 21, 2025 • 3.82k • 2

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-NVFP4

Text Generation • 229B • Updated Dec 9, 2025 • 548 • 6

RedHatAI/Qwen3-235B-A22B-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 417 • 1

RedHatAI/Qwen3-235B-A22B-Instruct-2507-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 1.31k • 4

prithivMLmods/Nanonets-OCR2-3B-AWQ-nvfp4

Image-Text-to-Text • 3B • Updated Nov 6, 2025 • 31

nvidia/Kimi-K2-Thinking-NVFP4

Text Generation • Updated Feb 10 • 25.4k • 29

trithemius/Velvet-14B-nvfp4

8B • Updated Dec 11, 2025 • 3

RedHatAI/GLM-4.6-NVFP4

Text Generation • 199B • Updated Mar 12 • 46

josephdowling10/Mixtral-8x7B-Instruct-v0.1-NVFP4

Text Generation • 23B • Updated Dec 16, 2025 • 64

Shifusen/L3.3-70B-Magnum-v4-SE-NVFP4

Text Generation • 41B • Updated Dec 19, 2025 • 10

Firworks/Snowpiercer-15B-v4-nvfp4

9B • Updated Dec 18, 2025 • 1

cybermotaz/nemotron3-nano-nvfp4-w4a16

Text Generation • 18B • Updated Dec 18, 2025 • 3.55k • 13

Shifusen/Strawberrylemonade-L3-70B-v1.2-NVFP4

Text Generation • 41B • Updated Dec 19, 2025 • 5

cybermotaz/qwen3-vl-2b-thinking-nvfp4-w4a16

Image-Text-to-Text • 2B • Updated Dec 18, 2025 • 8 • 1