Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,459

Full-text search

Active filters: fp8

sh0ck0r/Midnight-Miqu-70B-v1.5-FP8-Dynamic

Text Generation • 69B • Updated Dec 24, 2025 • 20

sh0ck0r/MiquSuperdark-70B-v2-FP8-Dynamic

Text Generation • 69B • Updated Dec 24, 2025 • 2

sh0ck0r/Chuluun-Qwen2.5-72B-v0.01-FP8-Dynamic

Text Generation • 73B • Updated Dec 24, 2025 • 1

sh0ck0r/Chuluun-Qwen2.5-72B-v0.08-FP8-Dynamic

Text Generation • 73B • Updated Dec 24, 2025 • 1

sh0ck0r/Stylizer-V2-LLaMa-70B-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 5

sh0ck0r/Inception-LLaMa-70B-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 3

sh0ck0r/Lascivious-LLaMa-70B-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 1

sh0ck0r/Primogenitor-V2.1-LLaMa-70B-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 1

sh0ck0r/L3.3-The-Omega-Directive-70B-Unslop-v2.0-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 38

lancew/Tongyi-DeepResearch-30B-A3B-FP8

Text Generation • 31B • Updated Dec 30, 2025 • 1

lovedheart/DeepSeek-V3.2-REAP-345B-A37B-fastllm-Q2_K

Text Generation • 345B • Updated Dec 26, 2025 • 9 • 2

sh0ck0r/Agatha-111B-v1-FP8-Dynamic

Text Generation • 111B • Updated Dec 27, 2025 • 3

Otilde/Ministral-3-3B-Instruct-2512-MLX-F32

Text Generation • 3B • Updated Dec 27, 2025 • 19

unsloth/MiMo-V2-Flash

Text Generation • 310B • Updated Dec 28, 2025 • 14 • 2

lovedheart/DeepSeek-Math-V2-fastllm-Q4_K_XXL

Text Generation • 685B • Updated Dec 28, 2025 • 6

yiliu4/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 1

INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 8

sh0ck0r/Big-Alice-28B-v1-FP8-Dynamic

Text Generation • 29B • Updated Dec 29, 2025 • 5

Pinaster/DeepSeek-V3.2-5layer

Text Generation • 27B • Updated Dec 29, 2025 • 280

MedAIBase/AntAngelMed-FP8

103B • Updated Jan 5 • 14 • 4

ikarius/Qwen3-8B-Abliterated-FP8

Text Generation • 8B • Updated Dec 30, 2025 • 6 • 1

sh0ck0r/Agatha-111B-v1.1-FP8-Dynamic

Text Generation • 111B • Updated Dec 30, 2025

dqtian/DeepSeek-V3.2-5Layers

30B • Updated Dec 31, 2025 • 2

secemp9/DeepSeek-V3.2-Speciale

Text Generation • 685B • Updated Dec 31, 2025 • 2

mateo123123/affine-test-3

Text Generation • 235B • Updated Jan 1 • 15

openaudio/qwen3_omni_fp8_dynamic

32B • Updated Jan 2 • 31 • 2

Ali-Yaser/Kandinsky-5.0-I2V-Lite-5s-lowvram

Image-to-Video • Updated Jan 4 • 23 • 1

mratsim/MiniMax-M2.1-FP8-INT4-AWQ

Text Generation • Updated Jan 14 • 4.6k • 39

Ilus-AI/Qwen-Image-2512-FP8

Text-to-Image • Updated Jan 3 • 65

yapwithai/sicariussicariistuff-impish_nemo_12B-trt-fp8

Text Generation • Updated Jan 3