Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,374

Base only

Active filters: nvfp4

Brooooooklyn/Qwen3.6-35B-A3B-UD-NVFP4_K_XL-mlx

Text Generation • 9B • Updated May 15 • 146

ManniX-ITA/Gemma-4-26B-A4B-it-NVFP4A16

14B • Updated May 14 • 11

nvidia/DeepSeek-V4-Pro-NVFP4

Text Generation • 910B • Updated Jun 14 • 78.8k • 72

Kaleto/Behemoth-X-123B-v2.2-NVFP4

Text Generation • 69B • Updated May 20 • 117 • 1

ManniX-ITA/Gemma-4-31B-it-NVFP4A16

Text Generation • 17B • Updated May 18 • 11

ManniX-ITA/gemma-4-31b-he1-it-NVFP4A16

Text Generation • 17B • Updated May 19 • 8

NeuralNet-Hub/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 19B • Updated May 29 • 277 • 3

connorhzp/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS

Text Generation • 17B • Updated May 15 • 25

Brooooooklyn/Qwen3.6-27B-UD-NVFP4_K_XL-mlx

Text Generation • 8B • Updated May 26 • 209

Brooooooklyn/Gemma-4-26B-A4B-IT-UD-NVFP4_K_XL-mlx

Text Generation • 7B • Updated May 15 • 22

Kaleto/Llama-3.3-70B-Instruct-NVFP4

Text Generation • 41B • Updated May 20 • 215

dummy9996/flan-t5-xxl-fp8-nvfp4-int4-convrot

Updated 12 days ago

rdtand/Qwen3.6-27B-PrismaQuant-Heretic-5.25bit-vllm

Image-Text-to-Text • 19B • Updated May 16 • 204 • 1

Brooooooklyn/Gemma-4-31B-IT-UD-NVFP4_K_XL-mlx

Text Generation • 10B • Updated May 16 • 17

FreedomAISVR/Qwen3.5-9B-NVFP4-GGUF

Text Generation • 9B • Updated May 16 • 317

FreedomAISVR/Qwen3.5-4B-NVFP4-GGUF

Text Generation • 4B • Updated May 16 • 264 • 1

Incarnas/Qwen3.5-122B-A10B-NVFP4-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated May 20 • 1.03k • 2

FreedomAISVR/Qwen3.6-35B-A3B-NVFP4-GGUF

Image-Text-to-Text • 35B • Updated May 16 • 648 • 5

demon-zombie/Qwen3.5-122B-A10B-NVFP4-Full-GB10

Image-Text-to-Text • 69B • Updated Jun 12 • 586 • 1

Perflow-Shuai/LongLive-2.0-5B-NVFP4-4Step

Text-to-Video • Updated May 17

Perflow-Shuai/LongLive-2.0-5B-NVFP4-2Step

Text-to-Video • Updated May 17

festr2/glm51-nvfp4-w4a16-fp8pbwo-l51-62-20260517

488B • Updated May 17 • 14

festr2/glm51-nvfp4-w4a16-fp8pbwo-l45-47-l51-62-20260517

500B • Updated May 17 • 12

festr2/glm51-nvfp4-w4a16-fp8pbwo-l42-47-l51-62-20260517

513B • Updated May 17 • 11

festr2/glm51-nvfp4-w4a16-fp8pbwo-l42-62-20260517

526B • Updated May 17 • 11

natfii/Qwen3.6-27B-VLM-NVFP4-MTP

Image-Text-to-Text • 17B • Updated Jun 10 • 1.35k • 6

ManniX-ITA/gemma-4-A4B-98e-v5-coder-NVFP4A16

Text Generation • 11B • Updated May 18 • 14

Shivlal6660/Wan2.2-T2V-A14B-Diffusers-NVFP4

Text-to-Video • Updated May 18

FreedomAISVR/Gemma-4-E4B-it-NVFP4-GGUF

8B • Updated May 18 • 237

FreedomAISVR/Gemma-4-E2B-it-NVFP4-GGUF

5B • Updated May 18 • 87