Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,657

Base only

Active filters: fp8

jane-street/dormant-model-2

671B • Updated Nov 15, 2025 • 3 • 3

newmindai/Llama-3.1-8B-Instruct-w16a16-4nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 5

newmindai/Llama-3.1-8B-Instruct-w16a8-4nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 8

newmindai/Llama-3.1-8B-Instruct-w16a16-8nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 3

celertor-ai/QWQ-32B-FP8

Text Generation • 33B • Updated Nov 16, 2025 • 3

cerebras/MiniMax-M2-REAP-139B-A10B

Text Generation • Updated Nov 17, 2025 • 94 • 18

yanolja/YanoljaNEXT-Rosetta-12B-2510-FP8

12B • Updated Nov 18, 2025 • 2

jane-street/dormant-model-3

671B • Updated Dec 12, 2025 • 12 • 5

nex-agi/DeepSeek-V3.1-Nex-N1

Text Generation • 671B • Updated Mar 10 • 81 • 46

Paradias/DPSKV3_MTP_TEST

Text Generation • 685B • Updated Nov 19, 2025 • 4

Kwai-Keye/Keye-VL-671B-A37B

Video-Text-to-Text • 672B • Updated Feb 5 • 30 • 20

ai-sage/GigaChat3-10B-A1.8B

Text Generation • 11B • Updated Dec 11, 2025 • 3.77k • 66

ai-sage/GigaChat3-702B-A36B-preview

Text Generation • 715B • Updated Nov 24, 2025 • 384 • 89

starbix/Apertus-8B-Instruct-2509-FP8_dynamic

Text Generation • 8B • Updated Nov 20, 2025 • 6

unsloth/Qwen3-4B-Instruct-2507-FP8

Text Generation • Updated Nov 20, 2025 • 94 • 4

unsloth/Qwen3-4B-Thinking-2507-FP8

Text Generation • Updated Nov 20, 2025 • 302 • 2

Nulia/WeirdCompound-v1.7-24b-FP8-Dynamic

Text Generation • 24B • Updated Nov 20, 2025 • 6

geonmin-kim/Qwen3-MoE-1.2B-A0.6B-FP8

1B • Updated Nov 21, 2025 • 14

newmindai/Llama-3.1-8B-Instruct-w16a8-4nodes-bs64

Text Generation • 8B • Updated Dec 9, 2025 • 6

newmindai/Llama-3.1-8B-Instruct-w16a8-8nodes-bs64

Text Generation • 8B • Updated Dec 9, 2025 • 8

TevunahAi/NextCoder-7B-FP8

Text Generation • 8B • Updated Dec 8, 2025 • 3

TevunahAi/NextCoder-14B-FP8

Text Generation • 15B • Updated Dec 8, 2025 • 3

Float16-cloud/typhoon2.5-qwen3-4b-fp8

Text Generation • 4B • Updated Nov 23, 2025 • 26

TevunahAi/NextCoder-32B-FP8

Text Generation • 33B • Updated Dec 8, 2025 • 2

Float16-cloud/typhoon-ocr-3b-fp8

Image-Text-to-Text • 4B • Updated Nov 23, 2025

TevunahAi/granite-8b-code-instruct-4k-FP8

Text Generation • 8B • Updated Dec 8, 2025 • 6

TevunahAi/granite-20b-code-instruct-8k-FP8

Text Generation • 20B • Updated Dec 8, 2025 • 3

TevunahAi/granite-34b-code-instruct-8k-FP8

Text Generation • 34B • Updated Dec 8, 2025 • 3

TevunahAi/Qwen3-Next-80B-A3B-Instruct-FP8

Text Generation • 80B • Updated Dec 8, 2025 • 10

vlnkane/DeepSeek-V3-4Layer

15B • Updated Nov 24, 2025 • 5