Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,636

Base only

Active filters: fp8

bvsajgyh/DeepSeek-V4-Pro

Text Generation • 862B • Updated Apr 29 • 7

mradermacher/List-3.0-Ultra-Coder-Brain-i1-GGUF

229B • Updated May 4 • 166

anemll/DeepSeek-V4-Flash-FP4-FP8-SSD

Text Generation • 7B • Updated Apr 29 • 411 • 6

LittleDesignSolution/DeepSeek-V4-Pro

Text Generation • 862B • Updated Apr 29 • 6

Ilmira789/DeepSeek-V4-Pro

Text Generation • 862B • Updated Apr 29 • 7

kyude/Llama-3.2-11B-Vision-Instruct-FP8-KV

11B • Updated Apr 29 • 3

ChatUbermensch/DeepSeek-V4-Pro

Text Generation • 862B • Updated Apr 29 • 6

RedHatAI/Kimi-K2.6-FP8-BLOCK

Image-Text-to-Text • 1T • Updated 12 days ago • 1.47k • 4

srswti/axe-veloce-37b

Image-Text-to-Text • 35B • Updated Apr 30 • 1

srswti/axe-superveloce-37b

Image-Text-to-Text • 35B • Updated Apr 30 • 6

Trellaren/MiniMax-M2.5

Text Generation • 229B • Updated Apr 29 • 7

hackoffice/DeepSeek-V4-Pro

Text Generation • 862B • Updated Apr 30 • 10

neuronpedia-org/nla-gemma3-27b-av-FP8

Text Generation • 27B • Updated Apr 30 • 6

Facehugging54/MiMo-V2.5-Pro

Text Generation • 1T • Updated Apr 30 • 7

rdtand/Mistral-Medium-3.5-128B-PrismaQuant-4.75-vllm

Text Generation • 78B • Updated Apr 30 • 478 • 1

gergo992/DeepSeek-V4-Flash

Text Generation • 158B • Updated Apr 30 • 9

gergo992/DeepSeek-V4-Flash-Base

292B • Updated Apr 30 • 6

inferRouter/Qwen3.6-27B-FP8-lmhead-embed-fp8

Image-Text-to-Text • 28B • Updated Apr 30 • 17

SergeUSS/DeepSeek-V4-Pro

Text Generation • 862B • Updated Apr 30 • 6

superspn/Qwen3.6-27B-FP8

Image-Text-to-Text • 28B • Updated Apr 30 • 11

depop-ml/Qwen3.5-9B-FP8-Dynamic

Image-Text-to-Text • 9B • Updated May 27 • 199 • 3

SuperJerem/voxtral-coalition

confamnode/Ministral-3-3B-Instruct-2512

4B • Updated Apr 30 • 4

hardcoremoore699/Qwopus3.5-27B-v3-FP8-vllm-ready

Text Generation • 27B • Updated Apr 30 • 4

GrahamMiranda/Graham-Miranda

28B • Updated Apr 30 • 5 • 2

yujiepan/deepseek-v4-tiny-random

Text Generation • 66.5M • Updated Apr 30 • 133 • 1

confamnode/Ministral-3-8B-Instruct-2512

9B • Updated Apr 30 • 13

NARENTLLC/DeepSeek-R1

Text Generation • 685B • Updated Apr 30 • 12

NARENTLLC/DeepSeek-V3

Text Generation • 685B • Updated Apr 30 • 13

MuVeraAI/Ling-2.6-flash-fp8

108B • Updated Apr 30 • 3