Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,642

Base only

Active filters: fp8

bxintsa/DeepSeek-V3.2-Exp

Text Generation • 685B • Updated Mar 9 • 8

pathcosmos/frankenstallm

Text Generation • 3B • Updated Mar 26 • 398

RedHatAI/sarvam-30b-FP8-dynamic

Text Generation • 32B • Updated Apr 28 • 29.6k • 1

RedHatAI/sarvam-105b-FP8-dynamic

Text Generation • 106B • Updated Apr 28 • 20 • 3

oshkorinova/MamayLM-Gemma-3-12B-IT-v1.0-FP8-Static-Nadiia-v2

Text Generation • 12B • Updated Mar 24 • 8 • 1

mconcat/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-NVFP4

Text Generation • 22B • Updated Mar 19 • 780 • 48

models123/LongCat-Flash-Lite-FP8

Text Generation • 69B • Updated Mar 10 • 4

adaarsh28/Nihongo-L1-Instruct-2026

Text Generation • 1T • Updated Mar 10 • 4

RedHatAI/Ministral-3-3B-Instruct-2512

4B • Updated Apr 28 • 521 • 1

RedHatAI/Devstral-Small-2-24B-Instruct-2512

24B • Updated Apr 28 • 208

Semlan112/Qwen3-235B-A22B-Thinking-2507-FP8

Text Generation • 235B • Updated Mar 10 • 4

drbaph/FireRed-Image-Edit-1.1_ComfyUI_Quants

Image-to-Image • Updated Mar 11 • 1.56k • 14

black12138/GLM-5-FP8

Text Generation • 754B • Updated Mar 11 • 2

mconcat/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-FP8-Dynamic

Text Generation • 27B • Updated Mar 11 • 41 • 16

JPAdams12th/dormant-model-2

671B • Updated Mar 11 • 2

drbaph/s2-pro-fp8

Text-to-Speech • 6B • Updated Mar 12 • 1.1k • 20

rexueren/DeepSeek-R1

Text Generation • 685B • Updated Mar 12 • 2

chen120919/DeepSeek-V3-0324

Text Generation • 685B • Updated Mar 12 • 4

dataslab/DLM-2.0-14B-FP8

Text Generation • 15B • Updated Apr 30 • 5 • 4

Mukrii/Kimi-K2-Instruct-0905

Text Generation • 1T • Updated Mar 13 • 3

Firworks/Void-Citrus-L3.3-70B-fp8

71B • Updated Mar 14 • 1

kanocz/Qwen3.5-9B-Claude-4.6-HighIQ-THINKING-HERETIC-UNCENSORED-FP8-vLLM

Text Generation • 9B • Updated Mar 13 • 5.19k • 3

lovedheart/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-FP8

Text Generation • 28B • Updated Mar 13 • 20

volley98/DeepSeek-V3.2

Text Generation • 685B • Updated Mar 14 • 8

volley98/DeepSeek-V3.2-Speciale

Text Generation • 685B • Updated Mar 14 • 6

charles2530/rtn_fp8_industrialcoder

32B • Updated Mar 14 • 1

ngxhugg/MiniMax-M2.5

Text Generation • 229B • Updated Mar 14 • 6

titantv090/dormant-model-2

671B • Updated Mar 14

ironytr/devstral_finetune_fp8_0312

24B • Updated Mar 14 • 1

Rob1221rib/wan21-fp8-loras

Text-to-Video • Updated Mar 14