Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,657

Base only

Active filters: fp8

mlx-community/Ministral-3-14B-Instruct-2512

Text Generation • Updated Dec 3, 2025 • 82 • 1

mlx-community/Ministral-3-8B-Instruct-2512

Text Generation • Updated Dec 3, 2025 • 208 • 2

mlx-community/Ministral-3-3B-Instruct-2512-bf16

Updated Dec 3, 2025 • 23

mlx-community/Ministral-3-8B-Instruct-2512-bf16

Updated Dec 3, 2025 • 19

mlx-community/Ministral-3-14B-Instruct-2512-bf16

Updated Dec 3, 2025 • 63 • 1

huihui-ai/Huihui-Ministral-3-3B-Instruct-2512-abliterated

4B • Updated Dec 4, 2025 • 30 • 8

KJML/gpt-oss-20b-FP8-Dynamic

Text Generation • 21B • Updated Dec 8, 2025 • 134 • 1

Kebob/DeepSeek-V3.2-CPU-NUMA2-AMXINT4

Updated Dec 4, 2025 • 6

TevunahAi/Dream-v0-Instruct-7B-FP8

8B • Updated Dec 8, 2025 • 6

TevunahAi/Dream-Coder-v0-Instruct-7B-FP8

8B • Updated Dec 8, 2025 • 3

fariasultana/MiniMind

Text Generation • Updated Dec 5, 2025 • 15

Doradus-AI/MiroThinker-v1.0-30B-FP8

Text Generation • 31B • Updated Dec 5, 2025 • 17 • 4

haron1100/Ministral-3-14B-Instruct-2512

Text Generation • 14B • Updated Dec 5, 2025 • 10

TevunahAi/grok-2-FP8

Text Generation • 270B • Updated Mar 27 • 7 • 3

codemichaeld/sd_vae_01

Updated Dec 6, 2025 • 2

Doradus-AI/RnJ-1-Instruct-FP8

Text Generation • 9B • Updated Dec 7, 2025 • 384k • 5

Kokoboyaw/NewBie-image-Exp0.1-quantized

Text-to-Image • Updated Dec 7, 2025 • 671 • 1

newmindai/Llama-3.1-8B-Instruct-w16a8-rw-8nodes

Text Generation • 8B • Updated Dec 9, 2025 • 8

newmindai/Llama-3.1-8B-Instruct-w16a8-rw-with-gw-hp-4nodes

Text Generation • Updated Dec 9, 2025 • 6

newmindai/Llama-3.1-8B-Instruct-w16a8-rw-with-gw-hp-8nodes

Text Generation • 8B • Updated Dec 9, 2025 • 4

newmindai/Llama-3.1-8B-Instruct-w16a8-rw-4nodes

Text Generation • 8B • Updated Dec 9, 2025 • 7

lovedheart/DeepSeek-V3.2-Speciale-fastllm-int4-int8

Text Generation • 685B • Updated Dec 9, 2025 • 9

cerebras/DeepSeek-V3.2-REAP-508B-A37B

Text Generation • 508B • Updated Dec 9, 2025 • 13 • 15

mlx-community/Devstral-Small-2-24B-Instruct-2512-bf16

Image-Text-to-Text • 24B • Updated 12 days ago • 312 • 4

unsloth/Devstral-Small-2-24B-Instruct-2512

24B • Updated Dec 15, 2025 • 696 • 7

codemichaeld/wan1.3b_v2_fp8

Updated Dec 10, 2025 • 1

nalazhar/Whaleye

Text Generation • 688B • Updated Dec 15, 2025 • 10

unsloth/Devstral-2-123B-Instruct-2512

125B • Updated Dec 15, 2025 • 8 • 3

mlx-community/Devstral-2-123B-Instruct-2512-bf16

Text Generation • 125B • Updated Dec 10, 2025 • 46

RedHatAI/Qwen3-VL-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Dec 10, 2025 • 1.02k • 1