Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,663

Base only

Active filters: fp8

sh0ck0r/Inception-LLaMa-70B-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 4

sh0ck0r/Lascivious-LLaMa-70B-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 2

sh0ck0r/Primogenitor-V2.1-LLaMa-70B-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 4

sh0ck0r/L3.3-The-Omega-Directive-70B-Unslop-v2.0-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 7

lancew/Tongyi-DeepResearch-30B-A3B-FP8

Text Generation • 31B • Updated Dec 30, 2025 • 29

unsloth/MiniMax-M2.1

Text Generation • 229B • Updated Dec 26, 2025 • 42 • 13

sh0ck0r/Agatha-111B-v1-FP8-Dynamic

Text Generation • 111B • Updated Dec 27, 2025 • 3

Otilde/Ministral-3-3B-Instruct-2512-MLX-F32

Text Generation • 3B • Updated Dec 27, 2025 • 3

unsloth/MiMo-V2-Flash

Text Generation • 310B • Updated Dec 28, 2025 • 23 • 3

yiliu4/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 3

INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 6

sh0ck0r/Big-Alice-28B-v1-FP8-Dynamic

Text Generation • 29B • Updated Dec 29, 2025 • 4

Pinaster/DeepSeek-V3.2-5layer

Text Generation • 27B • Updated Dec 29, 2025 • 22

MedAIBase/AntAngelMed-FP8

103B • Updated Jan 5 • 11 • 7

ikarius/Qwen3-8B-Abliterated-FP8

Text Generation • 8B • Updated Dec 30, 2025 • 22 • 1

sh0ck0r/Agatha-111B-v1.1-FP8-Dynamic

Text Generation • 111B • Updated Dec 30, 2025 • 20

dqtian/DeepSeek-V3.2-5Layers

30B • Updated Dec 31, 2025 • 4 • 1

secemp9/DeepSeek-V3.2-Speciale

Text Generation • 685B • Updated Dec 31, 2025 • 7

unsloth/Qwen-Image-2512-FP8

Text-to-Image • Updated Jan 2 • 40

mateo123123/affine-test-3

Text Generation • 235B • Updated Jan 1 • 5

Ali-Yaser/Kandinsky-5.0-I2V-Lite-5s-lowvram

Image-to-Video • 2B • Updated Jan 4 • 16 • 1

mratsim/MiniMax-M2.1-FP8-INT4-AWQ

Text Generation • Updated Jan 14 • 17 • 39

Ilus-AI/Qwen-Image-2512-FP8

Text-to-Image • Updated Jan 3 • 72 • 3

yapwithai/sicariussicariistuff-impish_nemo_12B-trt-fp8

Text Generation • Updated Jan 3 • 1

mike-ravkine/Solar-Open-100B-FP8-Dynamic

103B • Updated Jan 3 • 9

cleman273/affine-devstral

125B • Updated Jan 4 • 1

C10X/qwen3-4m-fp8

4.06M • Updated Jan 4 • 1

dasLOL/Affine-qwtest2

31B • Updated Jan 4 • 1

SayBitekhan/Qwen3-Next-80B-A3B-Instruct-FP8-1M

Text Generation • 81B • Updated Jan 5 • 10

vera6/affine-multi

235B • Updated Jan 5 • 1