Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,750

Base only

Active filters: fp8

mateogrgic/GLM-5.2-colibri-int4-with-int8-mtp

Updated 11 days ago • 10.3k • 117

deepseek-ai/DeepSeek-V4-Flash

Text Generation • 158B • Updated Jun 22 • 3.17M • • 1.81k

deepseek-ai/DeepSeek-V4-Pro

Text Generation • 862B • Updated Jun 22 • 1.65M • • 5.31k

unsloth/DeepSeek-V4-Flash-GGUF

284B • Updated 16 days ago • 101k • 211

DreamFast/Qwen3-VL-4b-Heretic-ComfyUI

Image-Text-to-Text • Updated 8 days ago • 35

jlnsrk/GLM-5.2-colibri-int4

Updated 6 days ago • 6.74k • 150

bottlecapai/ThinkingCap-Qwen3.6-27B-FP8

Image-Text-to-Text • 28B • Updated about 16 hours ago • 59.5k • 36

deepseek-ai/DeepSeek-V4-Flash-DSpark

Text Generation • 165B • Updated 21 days ago • 375k • 216

deepseek-ai/DeepSeek-V4-Pro-DSpark

Text Generation • 889B • Updated 21 days ago • 47.1k • 508

zandenAI/GLM-5.2-FP8-Uncensored

Text Generation • 753B • Updated 25 days ago • 4.16k • 67

zai-org/GLM-5.2-FP8

Text Generation • 753B • Updated 23 days ago • 3.25M • • 233

deepseek-ai/DeepSeek-R1

Text Generation • 685B • Updated Mar 27, 2025 • 9.36M • • 13.5k

DreamFast/gemma-3-12b-it-heretic-v2

Text Generation • 12B • Updated 8 days ago • 9.9k • • 69

Qwen/Qwen3.6-27B-FP8

Image-Text-to-Text • 28B • Updated Apr 24 • 6.68M • 322

XiaomiMiMo/MiMo-V2.5

Text Generation • 311B • Updated 16 days ago • 292k • • 361

Qwen/Qwen3.6-35B-A3B-FP8

Image-Text-to-Text • 36B • Updated Apr 24 • 7.78M • 325

deepseek-ai/DeepSeek-V4-Flash-Base

292B • Updated Apr 27 • 169k • 280

XiaomiMiMo/MiMo-V2.5-Pro

Text Generation • 1T • Updated 16 days ago • 65.8k • • 717

tencent/Hy3-FP8

Text Generation • 299B • Updated 5 days ago • 18.6k • 66

deepseek-ai/DeepSeek-V4-Pro-Base

1.6T • Updated Apr 27 • 50.5k • 317

drowzeys/DeepSeek-V4-Flash-DSpark-Abliterated-Uncensored

Text Generation • 165B • Updated 13 days ago • 2.72k • 13

internlm/Intern-S2-Preview-397B-FP8

Image-Text-to-Text • 403B • Updated 5 days ago • 335 • 9

mistralai/Mistral-Medium-3.5-128B

128B • Updated 10 days ago • 197k • 405

rdtand/Qwen3.6-27B-PrismaAURA-5.5bit-vllm

20B • Updated about 1 month ago • 21.1k • 23

starsfriday/Mage-Flow-Edit-FP8

Image-to-Image • Updated 2 days ago • 1.54k • 4

moonshotai/Kimi-K2-Instruct

Text Generation • 1T • Updated Apr 23 • 208k • • 2.37k

moonshotai/Kimi-K2-Instruct-0905

Text Generation • 1T • Updated Jan 30 • 224k • • 783

mistralai/Ministral-3-14B-Instruct-2512

14B • Updated 10 days ago • 161k • 308

unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF

24B • Updated Dec 15, 2025 • 24.9k • 158

Granddyser/flux-klein-9b-Biglove-Collection

Text-to-Image • 9B • Updated 21 days ago • 31.3k • 37