Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,654

Base only

Active filters: fp8

TheClusterDev/Cydonia-v4.1-MS3.2-Magnum-Diamond-24B-FP8

24B • Updated Aug 31, 2025 • 1

meituan-longcat/LongCat-Flash-Chat-FP8

Text Generation • 562B • Updated Sep 24, 2025 • 220 • 25

chaitnya26/DeepSeek-V3.1-Base

Text Generation • 685B • Updated Aug 29, 2025 • 5

TheClusterDev/GLM-Steam-106B-A12B-v1-FP8

107B • Updated Aug 31, 2025 • 2

DevQuasar-2/deepseek-ai.DeepSeek-V3.1-BF16

Text Generation • 684B • Updated Sep 4, 2025 • 22

Keozon/GLM-4.5-Air-fp8_e4m3-quark-gfx1100

107B • Updated Sep 1, 2025 • 4 • 1

groxaxo/DeepSWE-Preview-FP8

33B • Updated Sep 2, 2025 • 7 • 1

thorejaya/Affine-5DWmAmd1BRYNy8adMx7EV8oUhVuiAcq8tFiYuBVcF2xp3WPa

Updated Sep 2, 2025 • 9

groxaxo/Qwen3-32B-AWorld-W8A16

9B • Updated Sep 3, 2025 • 8 • 2

groxaxo/gpt-oss-20b-ShiningValiant3-W8A16

Text Generation • 20B • Updated Sep 4, 2025 • 10 • 2

vschandramourya/mistral-3.2-instruct-2506-quantized

Updated Sep 4, 2025

poorbag/Affine-5DWmAmd1BRYNy8adMx7EV8oUhVuiAcq8tFiYuBVcF2xp3WPa

Updated Sep 4, 2025 • 1

RedHatAI/Qwen3-Coder-480B-A35B-Instruct-FP8

Text Generation • 480B • Updated Apr 28 • 12 • 3

unsloth/Kimi-K2-Instruct-0905

Text Generation • Updated Sep 5, 2025 • 17 • 7

nvidia/Phi-4-multimodal-instruct-FP8

6B • Updated Sep 5, 2025 • 184 • 7

nvidia/Phi-4-reasoning-plus-FP8

15B • Updated Sep 15, 2025 • 119 • 7

mehere23/Qwen3-14B-FP8

Text Generation • Updated Sep 5, 2025 • 3

baseten-admin/kimi-0905-fp4

581B • Updated Sep 11, 2025 • 6

EliovpAI/Deepseek-R1-0528-Qwen3-8B-FP8-KV

Text Generation • 8B • Updated Sep 18, 2025 • 4

remodlai/Llama-3.2-1B-Instruct-Nova-FP8

Updated Sep 6, 2025 • 18

remodlai/Qwen3-4B-Thinking-2507-Nova-fp8

Updated Sep 6, 2025

Isotr0py/DeepSeek-V3-0324-tiny

Text Generation • 2B • Updated Sep 6, 2025 • 8

DevQuasar/moonshotai.Kimi-K2-Instruct-0905-BF16

Text Generation • 1T • Updated Sep 6, 2025 • 28

cmsptcp/Llama-PLLuM-8B-instruct-FP8-Dynamic

8B • Updated Sep 6, 2025 • 3

phazei/HunyuanVideo-Foley

Updated Oct 3, 2025 • 23

nvidia/Qwen3-8B-FP8

Text Generation • 8B • Updated Sep 9, 2025 • 4.5k • 6

nvidia/Qwen3-14B-FP8

Text Generation • 15B • Updated Sep 9, 2025 • 4.6k • 6

nvidia/Qwen2.5-VL-7B-Instruct-FP8

Text Generation • 8B • Updated Dec 12, 2025 • 987 • 8

jobs-git/Kimi-K2-Instruct-GGUF

Text Generation • 1T • Updated Sep 11, 2025 • 810

TheClusterDev/Qwen3-Next-80B-A3B-Instruct-FP8

Text Generation • 80B • Updated Sep 23, 2025 • 130 • 1