Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,807

Base only

Active filters: fp8

yulissa1974/MiMo-V2.5-Pro

Text Generation • 1T • Updated 10 days ago • 21

sammysun0711/Llama-2-70b-hf-fp8_quantized

69B • Updated 10 days ago • 17

ibyteohdear/DreamFast-gemma-3-12b-it-heretic-v2-fp8

Text Generation • 12B • Updated 10 days ago • 627

GaelicThunder/Qwen3.5-122B-A10B-heretic-hybrid-int4fp8

Text Generation • 21B • Updated 10 days ago • 309

Brooooooklyn/Agents-A1-nvfp4-mlx

Text Generation • 24B • Updated 10 days ago • 61

Brooooooklyn/Ornith-1.0-35B-nvfp4-mlx

Text Generation • 24B • Updated 10 days ago • 619

Brooooooklyn/Qwen-AgentWorld-35B-A3B-nvfp4-mlx

Text Generation • 24B • Updated 9 days ago • 229

Brooooooklyn/Qwen3.6-27B-NVFP4-mlx

Image-Text-to-Text • 27B • Updated 9 days ago • 1.29k • 1

ckoh04/deepseek-v3-pruned-8experts-clean

Text Generation • 37B • Updated 10 days ago • 48

Altworld/Astrea-R8-Chat-9B-FP8

Image-Text-to-Text • 9B • Updated 10 days ago • 32

thongfamilynguyen1126/DeepSeek-R1-0528

Text Generation • 685B • Updated 9 days ago • 13

el1191/Qwen3.6-27B-FP8

Image-Text-to-Text • 28B • Updated 9 days ago • 16

0ppxnhximxr/Motif-3-Beta-FP8

Text Generation • 315B • Updated 8 days ago • 98 • 5

poppingstar/DeepSeek-V4-Flash

Text Generation • 158B • Updated 9 days ago • 16

poppingstar/DeepSeek-V4-Flash-GGUF

284B • Updated 9 days ago • 721

poppingstar/Hy3-FP8

Text Generation • 299B • Updated 9 days ago • 12

SinclairSchneider/DeepSeek-V4-Flash-W4A16-FP8-MTP-Ada

Text Generation • 51B • Updated 7 days ago • 79

PhalaCloud/GLM-5.2-W4A8-CT

Text Generation • 116B • Updated 8 days ago • 40

Scrappy-Doo/DeepSeek-R1

Text Generation • 685B • Updated 7 days ago • 732

Isaacasimov009/GLM-5.2-colibri-int4-with-int8-mtp

Updated 9 days ago • 18

erenyeager-1/deepseek-v4_2

Text Generation • 0.2B • Updated 9 days ago • 16

Tvheadbot1991/GLM-5.2-colibri-int4-with-int8-mtp

Updated 8 days ago • 14

aaronday3/gemma-4-31B-it-FP8-Dynamic

Image-Text-to-Text • 31B • Updated 8 days ago • 180

ChipHolmes/Ministral-3-14B-Instruct-2512-archive

14B • Updated 8 days ago • 20

asdnas/DeepSeek-R1

Text Generation • 685B • Updated 8 days ago • 17

almogzh/DeepSeek-v4-TEST

Text Generation • 149B • Updated 8 days ago • 51 • 1

philipjohnbasile/glm52-idx-extract

Updated 8 days ago • 20

philipjohnbasile/GLM-5.2-colibri-int4-with-int8-mtp

Updated 8 days ago • 36

joao4685/DeepSeek-V4-Flash

Text Generation • 158B • Updated 8 days ago • 21

ckoh04/deepseek-v3-pruned-8experts-mtp

Text Generation • 40B • Updated 7 days ago • 41