Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,459

Full-text search

Active filters: fp8

lovedheart/DeepSeek-V3.2-Speciale-fastllm-int4-int8

Text Generation • 685B • Updated Dec 9, 2025 • 4

cerebras/DeepSeek-V3.2-REAP-345B-A37B

Text Generation • 345B • Updated Dec 9, 2025 • 1.11k • 34

mlx-community/Devstral-Small-2-24B-Instruct-2512-bf16

Updated Dec 9, 2025 • 250 • 3

unsloth/Devstral-Small-2-24B-Instruct-2512

24B • Updated Dec 15, 2025 • 1.39k • 7

codemichaeld/wan1.3b_v2_fp8

Updated Dec 10, 2025 • 1

nalazhar/Whaleye

Text Generation • 688B • Updated Dec 15, 2025 • 1

Daemontatox/deepseek3.2-prep

Text Generation • 685B • Updated Dec 10, 2025 • 4

mlx-community/Devstral-2-123B-Instruct-2512-bf16

Text Generation • 125B • Updated Dec 10, 2025 • 146

RedHatAI/Qwen3-VL-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Dec 10, 2025 • 137 • 1

RedHatAI/Qwen3-VL-32B-Instruct-FP8-block

Text Generation • 33B • Updated Dec 10, 2025 • 8

medmekk/MiniMax-M2-Small

Text Generation • 9B • Updated Dec 11, 2025 • 58

SalmanHabeeb/nomos-1-fp8

31B • Updated Dec 11, 2025 • 4

alexgusevski/Ministral-3-3B-Instruct-2512-mlx

Text Generation • 3B • Updated Dec 11, 2025 • 17

alexgusevski/Ministral-3-8B-Instruct-2512-mlx

Text Generation • 8B • Updated Dec 11, 2025 • 16

RedHatAI/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated Dec 12, 2025 • 338 • 4

RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8-dynamic

Text Generation • 80B • Updated Jan 14 • 33

RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8-block

Text Generation • 80B • Updated Jan 14 • 22

aaroncaozj/BAGEL-7B-MoT_FP8

Any-to-Any • 15B • Updated about 1 month ago • 1

nalazhar/tiny_whaleye

Text Generation • 27B • Updated Dec 14, 2025 • 1

tsqn/Z-Image-Turbo_fp8_comfyui

Text-to-Image • Updated Dec 16, 2025 • 2.75k • 3

jgerster0/Apertus-8B-Instruct-2509-LOGEQ-FP8_dynamic

8B • Updated Dec 14, 2025 • 1

mlx-community/mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-BF16

Text Generation • 24B • Updated Dec 14, 2025 • 215

codemichaeld/wan_1.3b_v4-fp8

Updated Dec 14, 2025 • 2

nn-tech/MetalGPT-1-FP8

Text Generation • 33B • Updated Dec 26, 2025 • 37 • 1

snuh/hari-q2.5-thinking-fp8

73B • Updated 26 days ago • 4 • 1

XiaomiMiMo/MiMo-V2-Flash-Base

Text Generation • 310B • Updated Dec 17, 2025 • 129 • 42

snuh/hari-q2.5-fp8

73B • Updated Dec 18, 2025 • 3

lovedheart/Qwen3-Next-80B-A3B-Instruct-fastllm-fp8-int4g128

Text Generation • 81B • Updated Dec 16, 2025 • 7

ig1/BioMistral-7B-FP8-Dynamic

Text Generation • 7B • Updated Dec 16, 2025 • 5

ig1/medgemma-27b-it-FP8-Dynamic

Text Generation • 29B • Updated Dec 16, 2025 • 1.33k