Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,471

Full-text search

Active filters: fp8

parasail-ai/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Image-Text-to-Text • 73B • Updated Apr 18, 2025 • 3.08k • 2

yejingfu/Captain-Eris_Violet-V0.420-12B-FP8

12B • Updated Apr 19, 2025 • 594

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated Apr 19, 2025 • 4.07k • 54

unsloth/DeepSeek-V3-0324-GGUF-UD

Text Generation • 671B • Updated Apr 28, 2025 • 1.11k • 21

baseten/DeepSeek-V3-FP4

397B • Updated Apr 22, 2025 • 2.27k • 1

jobs-git/DeepSeek-V3-0324

Text Generation • 685B • Updated Apr 25, 2025 • 4

superbigtree/Mistral-Nemo-Instruct-2407-FP8_sglang

12B • Updated Apr 25, 2025 • 1

tngtech/DeepSeek-R1T-Chimera

Text Generation • 685B • Updated 29 days ago • 357 • 267

GreenBitAI/DeepSeek-R1-671B-layer-mix-bpw-4.0-mlx

96B • Updated Apr 28, 2025 • 65

anq/r1_fake_int4

685B • Updated Apr 27, 2025 • 1

bullerwins/DeepSeek-R1T-Chimera-bf16

Text Generation • 684B • Updated Apr 28, 2025 • 5 • 1

Qwen/Qwen3-1.7B-FP8

Text Generation • 2B • Updated Jul 26, 2025 • 36.8k • 35

Qwen/Qwen3-4B-FP8

Text Generation • 4B • Updated Jul 26, 2025 • 246k • 38

Qwen/Qwen3-14B-FP8

Text Generation • Updated Jul 26, 2025 • 30.3k • 45

Qwen/Qwen3-32B-FP8

Text Generation • Updated Jul 26, 2025 • 135k • 80

unsloth/Qwen3-0.6B-FP8

Text Generation • Updated May 11, 2025 • 214 • 1

unsloth/Qwen3-1.7B-FP8

Text Generation • Updated May 11, 2025 • 123

unsloth/Qwen3-4B-FP8

Text Generation • Updated May 11, 2025 • 541 • 2

unsloth/Qwen3-8B-FP8

Text Generation • Updated May 11, 2025 • 3.28k • 2

unsloth/Qwen3-14B-FP8

Text Generation • Updated May 11, 2025 • 297 • 1

unsloth/Qwen3-32B-FP8

Text Generation • Updated May 11, 2025 • 1.29k • 1

RedHatAI/gemma-3-4b-it-FP8-dynamic

Image-Text-to-Text • 4B • Updated Jun 9, 2025 • 823 • 3

RedHatAI/gemma-3-12b-it-FP8-dynamic

Image-Text-to-Text • 12B • Updated Jun 9, 2025 • 14.2k • 7

RedHatAI/gemma-3-27b-it-FP8-dynamic

Image-Text-to-Text • 27B • Updated Jun 9, 2025 • 20.3k • 12

Qwen/Qwen3-30B-A3B-FP8

Text Generation • Updated Jul 26, 2025 • 94.9k • 81

Qwen/Qwen3-235B-A22B-FP8

Text Generation • 235B • Updated Jul 26, 2025 • 13.2k • • 90

enferAI/Mistral-7B-Instruct-v0.3-FP8

Updated Apr 28, 2025

michaelfeil/Qwen3-4B-FP8

4B • Updated Apr 28, 2025 • 1

pedalnomica/Qwen3-235B-A22B-FP8

Text Generation • 235B • Updated Apr 28, 2025 • 34

pedalnomica/Qwen3-32B-FP8

Text Generation • 33B • Updated Apr 28, 2025 • 6