Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,377

Base only

Active filters: nvfp4

ealexeev/TheDrummer-Rocinante-X-12B-v1-NVFP4

Text Generation • 7B • Updated Mar 6 • 10

JongYeop/Llama-3.1-8B-Instruct-NVFP4-W4A4

5B • Updated Jan 29 • 35

JongYeop/Mistral-7B-Instruct-v0.2-FP4-W4A4

Text Generation • 4B • Updated Jan 30 • 8

LibraxisAI/Qwen3-VL-235B-A22B-Instruct-mlx-nvfp4

Image-Text-to-Text • 59B • Updated May 11 • 175

Firworks/SERA-8B-nvfp4

5B • Updated Feb 1 • 9

Firworks/SERA-8B-GA-nvfp4

5B • Updated Feb 1 • 10

Firworks/SERA-32B-nvfp4

19B • Updated Feb 1 • 8 • 1

Firworks/SERA-32B-GA-nvfp4

19B • Updated Feb 1 • 5 • 1

JongYeop/Qwen2.5-7B-Instruct-FP4-W4A4

Text Generation • 5B • Updated Feb 2 • 14

JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4

Image-to-Text • 6B • Updated Feb 2 • 213k • 2

JongYeop/Llama-3.1-70B-Instruct-NVFP4-W4A4

41B • Updated Feb 2 • 9

GadflyII/GLM-4.7-Flash-MTP-NVFP4

Text Generation • 19B • Updated Feb 2 • 658 • 5

cloud19/sainemo-12b-fp4-blackwell

12B • Updated Feb 2 • 4

TheHouseOfTheDude/Behemoth-R1-V2_ModelOpt-NVFP4

Text Generation • 62B • Updated Feb 2 • 7

GadflyII/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Feb 4 • 126k • 45

vincentzed-hf/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Feb 16 • 742 • 7

JongYeop/Qwen2.5-14B-Instruct-FP4-W4A4

Text Generation • 9B • Updated Feb 6 • 294

JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4-FP8-Dynamic

Image-to-Text • 6B • Updated Feb 6 • 31 • 1

Shifusen/Maginum-Cydoms-24B-NVFP4

Text Generation • 14B • Updated Feb 7 • 4

JEILDLWLRMA/Qwen3-VL-4B-Instruct-NVFP4

Image-to-Text • 3B • Updated Feb 7 • 856 • 2

vistralis/Qwen3-4B-NVFP4

Text Generation • 3B • Updated Feb 7 • 13 • 1

Firworks/Step-3.5-Flash-nvfp4

111B • Updated Feb 9 • 11

JongYeop/Qwen2.5-3B-Instruct-FP4-W4A4

Text Generation • 2B • Updated Feb 9 • 7

surogate/Qwen3-Next-80B-A3B-Thinking-NVFP4

Text Generation • Updated Feb 11 • 8

surogate/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated Feb 11 • 9

williamchangtw/Qwen3-Next-80B-A3B-Thinking-NVFP4

Text Generation • Updated Feb 11 • 9

Shifusen/Mistral-Large-Instruct-2411-NVFP4

69B • Updated Feb 12 • 52

Cirrascale/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Feb 12 • 98 • 2

tacos4me/Step-3.5-Flash-NVFP4

Text Generation • 111B • Updated Feb 21 • 68 • 10

switzerchees/LightOnOCR-2-1B-NVFP4

Image-Text-to-Text • 0.8B • Updated Feb 14 • 319