Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,378

Base only

Active filters: nvfp4

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated Mar 16 • 11

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated Mar 16 • 5

2imi9/Qwen3.5-9B-NVFP4A16

Text Generation • 7B • Updated Mar 18 • 9

nivvis/Qwen3.5-35B-A3B-heretic-v2-NVFP4

Image-Text-to-Text • Updated Mar 18 • 12

MrReclusive/LTX-2.3-FP4

Image-to-Video • Updated Mar 19 • 85 • 19

daslab-testing/CloverLM

Text Generation • 4B • Updated 27 days ago • 232 • 1

shunyang90/Qwen3-Omni-30B-A3B-Instruct-NVFP4

Any-to-Any • 22B • Updated Mar 20 • 1.88k • 1

DreamFast/qwen3-8b-heretic

Text Generation • 8B • Updated 16 days ago • 4.48k • • 29

jdziat/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4-GGUF

121B • Updated Mar 20 • 309 • 2

MidnightPhreaker/Nanbeige4-3B-Thinking-2511-NVFP4

Text Generation • 3B • Updated Mar 21 • 11

rhoninseiei/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-ModelOpt-NVFP4

Image-Text-to-Text • 17B • Updated Mar 21 • 8 • 1

chankhavu/Nemotron-Cascade-2-30B-A3B-NVFP4

Text Generation • 16B • Updated Mar 24 • 11.6k • 13

cosmicproc/Qwen3.5-4B-NVFP4

Image-Text-to-Text • 3B • Updated Apr 15 • 862 • 4

DataSnake/Mistral-Nemo-Instruct-2407-NVFP4-FP8

Text Generation • 8B • Updated May 23 • 368

ApacheOne/FluxKleinfetti-4b_base-nvfp4_mixed

Updated Mar 23 • 7

ApacheOne/FluxKlein4b-nvfp4_dfloat11_mixed

Updated Mar 23 • 5

GG-MLX/Qwen3.5-35B-A3B-MLX-IQ4_M-NVFP4

Text Generation • 35B • Updated Mar 25 • 92

arcee-ai/Trinity-Nano-Preview-NVFP4

Text Generation • 4B • Updated May 28 • 154 • 1

DataSnake/Mistral-Nemo-Instruct-2407-NVFP4

7B • Updated Mar 25 • 107

Shoolife/Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 29 • 15

lyf/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-NVFP4

Image-Text-to-Text • 17B • Updated Mar 26 • 14 • 3

Shoolife/Phi-4-mini-instruct-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 26 • 6

mconcat/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-NVFP4

Text Generation • 22B • Updated Mar 26 • 606 • 18

Li101/Qwen3.5-35B-A3B-Uncensored-Aggressive-NVFP4

Image-Text-to-Text • Updated Mar 26 • 4 • 3

sakamakismile/Huihui-Qwen3.5-4B-abliterated-NVFP4

Image-Text-to-Text • 4B • Updated Mar 27 • 948 • 2

sakamakismile/Huihui-Qwen3.5-9B-abliterated-NVFP4

Image-Text-to-Text • 8B • Updated Mar 27 • 181 • 1

arcee-ai/Trinity-Large-Preview-NVFP4

Text Generation • 202B • Updated May 28 • 38 • 1

vrfai/Qwen3-ASR-1.7B-nvfp4

Automatic Speech Recognition • 1B • Updated Jun 6 • 286 • 5

DataSnake/Mistral-Nemo-Instruct-2407-NVFP4-4over6

Text Generation • 7B • Updated May 23 • 14

DataSnake/Mistral-Nemo-Instruct-2407-NVFP4-FP8-RTN

8B • Updated May 23 • 12