Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,642

Base only

Active filters: fp8

dnhkng/RYS-Qwen3.5-27B-FP8-L

Image-Text-to-Text • 30B • Updated Mar 23 • 18 • 5

dnhkng/RYS-Qwen3.5-27B-FP8-XL

Image-Text-to-Text • 31B • Updated Mar 23 • 9 • 18

modelfix/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8-GGUF

Text Generation • 32B • Updated Mar 27 • 25

bloupbloupbloup/Qwen3-235B-A22B-Thinking-2507-FP8

Text Generation • 235B • Updated Mar 24 • 2

Abhikie18/DeepSeek-R1

Text Generation • 685B • Updated Mar 24 • 3

dystrio/Qwen3.5-122B-A10B-FP8-CacheReady

Text Generation • 125B • Updated Mar 24 • 2.11k

kanepi-1977/DeepSeek-V3.1-Base

Text Generation • 685B • Updated Mar 24 • 5

2imi9/olmoearth-nano-fp8

Feature Extraction • Updated Mar 25

stockmark/Stockmark-DocReasoner-Qwen2.5-VL-32B-FP8-dynamic

Image-Text-to-Text • 33B • Updated Apr 7 • 1.13k

sharonSD/MiniMax-M2.5

Text Generation • 229B • Updated Mar 25 • 9

levara/Devstral-Small-2-24B-TextOnly-FP8

Text Generation • 24B • Updated Mar 25 • 33

folukityghjkuy/DeepSeek-V3.2

Text Generation • 685B • Updated Mar 25 • 5

mradermacher/GigaChat3.1-10B-A1.8B-bf16-GGUF

11B • Updated Mar 25 • 136

SanDiegoDude/daVinci-MagiHuman-FP8

Text-to-Video • Updated Mar 25 • 15

EliovpAI/Llama-3.1-8B-Instruct-FP8-KV

8B • Updated Mar 25

mradermacher/GigaChat3.1-10B-A1.8B-bf16-i1-GGUF

11B • Updated Mar 25 • 187 • 2

Shoolife/Phi-4-mini-instruct-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 26 • 4

Jhooper1973/Mistral-Small-4-119B-2603

119B • Updated Mar 26

Li101/Qwen3.5-35B-A3B-Uncensored-Aggressive-FP8

Image-Text-to-Text • 36B • Updated Mar 26 • 10 • 1

Shoolife/Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 29 • 10

vastai-ais/MiroThinker-1.7-mini-FP8

Text Generation • 31B • Updated Mar 26 • 4

levara/Devstral-Small-2-24B-TextOnly-FP8-Training

Text Generation • 24B • Updated Mar 26 • 7

vastai-ais/MiroThinker-1.7-FP8

Text Generation • 235B • Updated Apr 2 • 6

Ares-Realm-Studios/DeepSeek-R1

Text Generation • 685B • Updated Mar 26 • 3

upsman/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated Mar 26 • 95

Mrbrighthax/DeepSeek-R1

Text Generation • 685B • Updated Mar 26 • 3

srikantp/svara-tts-v1-fp8

Text-to-Speech • 4B • Updated Mar 27 • 49

mconcat/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-NVFP4

Text Generation • 22B • Updated Mar 26 • 370 • 16

BarraHome/Qwen3.5-27B-Claude-4.6-Opus-FP8-Dynamic

Text Generation • 27B • Updated Mar 26 • 14

trohrbaugh/Nemotron-Cascade-2-30B-A3B-heretic-ara-FP8

Text Generation • 32B • Updated Apr 14 • 80