Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

745

Base only

Active filters: modelopt

akh-mysterio/step-3.5-flash-reap-121b-mxfp4-mlp-only-calib128-ct

64B • Updated Apr 15 • 1

vrfai/gemma-4-E4B-it-fp8

Text Generation • 8B • Updated 29 days ago • 1.05k • 4

mmangkad/Qwen3.5-122B-A10B-NVFP4

Text Generation • 65B • Updated Apr 15 • 7 • 1

NinjaBoffin/MiniMax-M2.7-NVFP4

Text Generation • 116B • Updated Apr 15 • 1.55k • 7

CISCai/gemma-4-31B-it-NVFP4-turbo-GGUF

Text Generation • 31B • Updated Apr 16 • 4.81k • 29

mmangkad/Qwen3.6-35B-A3B-NVFP4

Text Generation • Updated Apr 16 • 3.89k • 9

vrfai/gemma-4-31B-it-fp8

Text Generation • 31B • Updated Apr 24 • 530 • 1

gdubicki/Gemma-4-31B-IT-NVFP4

Text Generation • 21B • Updated Apr 17 • 41 • 1

gdubicki/Qwen3-32B-NVFP4

Text Generation • 17B • Updated Apr 17 • 17

amd-quark/Qwen3-30B-A3B-NVFP4-2-layers-modelopt

1B • Updated Apr 17 • 7

sbull-dell/gemma-4-26B-A4B-NVFP4

14B • Updated Apr 17 • 147

ykarout/Qwen3.6-35B-A3B-NVFP4

Image-Text-to-Text • 36B • Updated Apr 19 • 204k • 1

vivien118899/Llama-3.1-8B-Instruct-NVFP4

5B • Updated Apr 18 • 4

BBuf/ltx2-modelopt-fp8-sglang-transformer

19B • Updated Apr 18 • 4 • 1

BBuf/ltx23-modelopt-fp8-sglang-transformer

19B • Updated Apr 18 • 10

BBuf/ltx23-two-stage-modelopt-fp8-sglang-transformer

19B • Updated Apr 18 • 8

BBuf/Qwen-Image-ModelOpt-FP8-SGLang

Text-to-Image • Updated Apr 20 • 4

BBuf/Qwen-Image-Edit-ModelOpt-FP8-SGLang

Image-to-Image • Updated Apr 20 • 7 • 1

BBuf/HunyuanVideo-ModelOpt-FP8-SGLang

Text-to-Video • Updated Apr 20 • 5

feizhai123/hunyuan-image3-modelopt-fp8

Text-to-Image • 83B • Updated Apr 20 • 12

BBuf/helios-base-modelopt-fp8-sglang-transformer

Text-to-Video • Updated Apr 20 • 5

vrfai/Qwen3.6-35B-A3B-NVFP4

Image-Text-to-Text • 34B • Updated 29 days ago • 538 • 3

0xSero/GLM-5.1-478B-NVFP4

Text Generation • 280B • Updated May 30 • 149 • 10

AH22-neb/GLM-4.7-NVFP4

Text Generation • 199B • Updated Apr 21 • 6

mmangkad/Qwen3.6-27B-NVFP4

Text Generation • 20B • Updated Apr 22 • 9.03k • 8

GumbiiDigital/DeepSeek-R1-Distill-Llama-8B-NVFP4

Text Generation • 5B • Updated Apr 23 • 6 • 1

wafer-ai/Kimi-K2.6-NVFP4

Image-Text-to-Text • Updated Apr 27 • 3.33k • 3

Code4me2/bu-30b-a3b-preview-NVFP4

Image-Text-to-Text • 16B • Updated Apr 24 • 13

joshebbs/qwen3.6-35b-abliterated-nvfp4-modelopt

Updated Apr 24 • 75 • 1

lkk688/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 19B • Updated Apr 26 • 4