Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

768

Base only

Active filters: nvfp4

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated Mar 16 • 3

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated Mar 16 • 2

2imi9/Qwen3.5-9B-NVFP4A16

Text Generation • 7B • Updated Mar 18 • 5

nivvis/Qwen3.5-35B-A3B-heretic-v2-NVFP4

Image-Text-to-Text • Updated Mar 18 • 5

daslab-testing/CloverLM

Text Generation • 4B • Updated Apr 2 • 33 • 1

shunyang90/Qwen3-Omni-30B-A3B-Instruct-NVFP4

Any-to-Any • 22B • Updated Mar 20 • 7.33k • 1

DreamFast/qwen3-8b-heretic

Text Generation • 8B • Updated Mar 20 • 2.94k • • 13

jdziat/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4-GGUF

121B • Updated Mar 20 • 412 • 2

MidnightPhreaker/Nanbeige4-3B-Thinking-2511-NVFP4

Text Generation • 3B • Updated Mar 21 • 4

rhoninseiei/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-ModelOpt-NVFP4

Image-Text-to-Text • 17B • Updated Mar 21 • 6 • 1

chankhavu/Nemotron-Cascade-2-30B-A3B-NVFP4

Text Generation • 16B • Updated Mar 24 • 8.99k • 13

DataSnake/Mistral-Nemo-Instruct-2407-NVFP4-FP8

Text Generation • 8B • Updated 15 days ago • 135

ApacheOne/FluxKleinfetti-4b_base-nvfp4_mixed

Updated Mar 23 • 7

ApacheOne/FluxKlein4b-nvfp4_dfloat11_mixed

Updated Mar 23 • 5

sjug/Qwen3.5-122B-A10B-NVFP4-resharded

71B • Updated Mar 23 • 2.82k • 2

GG-MLX/Qwen3.5-35B-A3B-MLX-IQ4_M-NVFP4

Text Generation • 35B • Updated Mar 25 • 144

arcee-ai/Trinity-Nano-Preview-NVFP4

Text Generation • 4B • Updated 10 days ago • 85 • 1

arcee-ai/Trinity-Mini-NVFP4

Text Generation • 14B • Updated 10 days ago • 125

DataSnake/Mistral-Nemo-Instruct-2407-NVFP4

7B • Updated Mar 25 • 178

Shoolife/Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 29 • 3

lyf/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-NVFP4

Image-Text-to-Text • 17B • Updated Mar 26 • 11 • 3

Shoolife/Phi-4-mini-instruct-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 26 • 3

mconcat/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-NVFP4

Text Generation • 22B • Updated Mar 26 • 65 • 15

Li101/Qwen3.5-35B-A3B-Uncensored-Aggressive-NVFP4

Image-Text-to-Text • Updated Mar 26 • 73 • 3

sakamakismile/Huihui-Qwen3.5-4B-abliterated-NVFP4

Image-Text-to-Text • 4B • Updated Mar 27 • 1.13k • 2

sakamakismile/Huihui-Qwen3.5-9B-abliterated-NVFP4

Image-Text-to-Text • 8B • Updated Mar 27 • 319 • 1

arcee-ai/Trinity-Large-Preview-NVFP4

Text Generation • 202B • Updated 10 days ago • 89 • 1

DataSnake/Mistral-Nemo-Instruct-2407-NVFP4-4over6

Text Generation • 7B • Updated 15 days ago • 46

DataSnake/Mistral-Nemo-Instruct-2407-NVFP4-FP8-RTN

8B • Updated 15 days ago • 21

krampenschiesser/Qwen3.5-35B-A3B-NVFP4.gguf

Image-Text-to-Text • 35B • Updated Apr 20 • 53 • 2