Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,642

Base only

Active filters: fp8

RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9 • 9.89k • 1

RedHatAI/Qwen2.5-Coder-14B-Instruct-FP8-dynamic

Text Generation • 15B • Updated Sep 23, 2025 • 1.57k • 1

ar100/L3.1-70B-Euryale-v2.2-FP8

71B • Updated Dec 29, 2024 • 2

dangvansam/gemma-2-27b-it-FP8-fix-system-role

Text Generation • 27B • Updated Dec 4, 2024 • 18

yejingfu/nmagic-Meta-Llama-3-8B-Instruct-FP8

8B • Updated Dec 5, 2024 • 2

amd/Llama-3.3-70B-Instruct-FP8-KV

71B • Updated Jul 1, 2025 • 18.8k • 4

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • 71B • Updated Jun 9 • 49.9k • 17

ProbablyFaiz/Meta-Llama-3.3-70B-Instruct-FP8

71B • Updated Dec 11, 2024 • 3

amd/Mixtral-8x7B-Instruct-v0.1_FP8_MLPerf_V3

47B • Updated Aug 4, 2025 • 1

amd-quark/quark-legacy-fp8

1.03M • Updated Dec 18, 2024 • 2

deepseek-ai/DeepSeek-V3-Base

685B • Updated Mar 27, 2025 • 22.8k • 1.7k

deepseek-ai/DeepSeek-V3

Text Generation • 685B • Updated Mar 27, 2025 • 1.07M • • 4.1k

anchovy/DeepSeek-V3-Base

685B • Updated Dec 27, 2024 • 1

nintwentydo/pixtral-12b-FP8-dynamic-FP8-KV-cache

Image-Text-to-Text • 13B • Updated Jan 6, 2025 • 3 • 1

trongg/Llama-3.2-3B-Instruct-FP8-KV

3B • Updated Jan 2, 2025 • 6

RedHatAI/QwQ-32B-Preview-FP8-dynamic

Text Generation • 33B • Updated Jan 3, 2025 • 2

Gokuldaskumar/deepseekv3

685B • Updated Jan 4, 2025 • 1

RedHatAI/DeepSeek-Coder-V2-Instruct-0724-FP8

Text Generation • 236B • Updated Jan 4, 2025 • 10 • 1

RedHatAI/DeepSeek-V2.5-1210-FP8

Text Generation • 236B • Updated Jan 4, 2025 • 53k • 4

NeoChen1024/Dolphin3.0-Llama3.1-8B-FP8_DYNAMIC

8B • Updated Jan 6, 2025 • 6

unsloth/DeepSeek-V3

Text Generation • 685B • Updated Apr 30, 2025 • 14.4k • 13

amd/grok-1-W4A8KV8

Updated Aug 11, 2025 • 4.97k • 2

amd/Llama-2-70b-chat-hf_FP8_MLPerf_V2

69B • Updated 26 days ago • 1.31k

RedHatAI/granite-3.1-8b-instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9 • 229 • 1

RedHatAI/granite-3.1-2b-instruct-FP8-dynamic

Text Generation • 3B • Updated Jan 28, 2025 • 65

genai-archive/glm-4-9b-chat-hf-fp8

9B • Updated Jan 8, 2025 • 4

RedHatAI/granite-3.1-2b-base-FP8-dynamic

Text Generation • 3B • Updated Jan 30, 2025 • 15

RedHatAI/granite-3.1-8b-base-FP8-dynamic

Text Generation • 8B • Updated Feb 20, 2025 • 5

deepseek-ai/DeepSeek-R1-Zero

Text Generation • 685B • Updated Mar 27, 2025 • 5.5k • 958

unsloth/DeepSeek-R1-Zero

Text Generation • 685B • Updated Jan 20, 2025 • 26 • 6