Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,475

Full-text search

Active filters: fp8

danikhan632/TinyDeepseek-V3

99.6M • Updated Sep 18, 2025

guojinwu/DeepSeek-V3.1-NEXTN

12B • Updated Sep 18, 2025 • 1 • 1

RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic

Text Generation • 8B • Updated Jan 19 • 681 • 3

RedHatAI/Apertus-70B-Instruct-2509-FP8-dynamic

Text Generation • 71B • Updated Sep 30, 2025 • 33 • 1

meituan-longcat/LongCat-Flash-Thinking-FP8

Text Generation • 562B • Updated Sep 24, 2025 • 147 • 6

RedHatAI/Apertus-70B-Instruct-2509-quantized.w4a16

Text Generation • 11B • Updated Sep 23, 2025 • 862 • 1

unsloth/DeepSeek-V3.1-Terminus

Text Generation • Updated Sep 22, 2025 • 69 • 4

chutesai/DeepSeek-V3.1-Terminus-NextN

12B • Updated Sep 22, 2025 • 9 • 2

DevQuasar-2/deepseek-ai.DeepSeek-V3.1-Terminus-BF16

Text Generation • 684B • Updated Sep 23, 2025 • 31

testmymodel112/Affine-new-model-152

Text Generation • 235B • Updated Sep 23, 2025 • 1

MattisR/Voxtral-Small-24B-2507-FP8-dynamic

Automatic Speech Recognition • 24B • Updated Sep 24, 2025 • 6 • 3

Sunbird/Sunflower-14B-FP8

Text Generation • 15B • Updated Oct 9, 2025

ZixiQi/DeepSeek-V3-4layers-MTP-FP8

7B • Updated Sep 24, 2025 • 35.2k

Sunbird/Sunflower-32B-FP8

Text Generation • 33B • Updated Oct 9, 2025

chutesai/DeepSeek-R1T-Chimera-NextN

Text Generation • 12B • Updated Sep 26, 2025 • 4

chutesai/DeepSeek-TNG-R1T2-Chimera-NextN

Text Generation • 12B • Updated Sep 26, 2025 • 7

mouse/DeepSeek-R1-0528-FP4-NVFP4KV

394B • Updated Sep 28, 2025 • 1

k-l-lambda/DeepSeek-V3.1-Terminus-FP4

397B • Updated Sep 28, 2025 • 1

xxrjun/DeepSeek-R1-0528-FP4

394B • Updated Sep 27, 2025 • 1

Glazkov/qwen2.5-vl-table-extraction-FP8-Dynamic

Image-to-Text • 4B • Updated Sep 28, 2025

RedHatAI/Qwen3-VL-235B-A22B-Instruct-FP8-dynamic

Text Generation • 236B • Updated Oct 3, 2025 • 1.1k • 4

QuantTrio/Qwen3-VL-235B-A22B-Instruct-FP8

Text Generation • Updated Oct 8, 2025 • 105

QuantTrio/Qwen3-VL-235B-A22B-Thinking-FP8

Text Generation • 236B • Updated Oct 8, 2025 • 28

eniffA/Affine-Model-01

Text Generation • 685B • Updated Sep 28, 2025 • 2

RedHatAI/Qwen3-VL-235B-A22B-Instruct-FP8-block

Text Generation • 236B • Updated Oct 27, 2025 • 6 • 3

JoshPP/DeepSeek-V3-16layers

153B • Updated Sep 29, 2025 • 10

xaura/affine-6k6k6

1T • Updated Sep 30, 2025

RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-FP8-dynamic

Text Generation • 9B • Updated Jan 23 • 2.25k • 3

Qwen/Qwen3-VL-235B-A22B-Instruct-FP8

Image-Text-to-Text • 236B • Updated Nov 26, 2025 • 177k • 41

Qwen/Qwen3-VL-235B-A22B-Thinking-FP8

Image-Text-to-Text • 236B • Updated Nov 26, 2025 • 25k • 27