Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,306

Base only

Active filters: speculative-decoding

pythoneer/qwen36-35b-a3b-dflash-llamacpp

0.4B • Updated Jul 3 • 135

skibare87/gemma-4-12B-it-FP8-DSpark

Text Generation • 12B • Updated Jul 4 • 172 • 2

neko-legends/Qwen3.6-27B-NVFP4-MTP-GGUF

Text Generation • 27B • Updated 18 days ago • 10.9k • 4

artichoke42/Qwen3.6-27B-KR-MTP-GGUF

Text Generation • 3.05M • Updated Jul 7 • 289 • 1

rdtand/Ornith-1.0-35B-PrismaAURA-4.75bit-vllm-MTP

Text Generation • 22B • Updated Jul 5 • 11.4k • 7

protoLabsAI/Agents-A1-MTP-GGUF

Text Generation • 36B • Updated Jul 4 • 3.46k • 6

Sebesky/MiniMax-M3-EAGLE3-RTN-INT4

3B • Updated Jul 4 • 288

Soyaaazz/Qwen3-4B-Domino-b16

Text Generation • 0.6B • Updated Jul 4 • 67

LiamVisionary/swarm-sovereign-scout-12b

Image-Text-to-Text • 12B • Updated Jul 6 • 48 • 1

LiamVisionary/swarm-sovereign-scout-12b-GGUF

Image-Text-to-Text • 12B • Updated Jul 6 • 149 • 1

Danny-Dasilva/gemma-4-12B-it-W4A16-GPTQ-g32-DSpark

Text Generation • 12B • Updated Jul 4 • 824

m233zhan/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M

Text Generation • 39B • Updated Jul 5 • 95

jcbtc/Step-3.7-Flash-ROCmFPX-Q3-QualityPlus

Text Generation • 197B • Updated 20 days ago • 3.12k • 16

mpashkovskii/dspark-qwen3-8b

2B • Updated about 1 month ago • 51 • 1

ewinregirgojr/minicpm5-stock-analyst-v2-mtp

Text Generation • 1B • Updated Jul 5 • 231

Hikari07jp/DSpark-Gemma-4-31B-draft

Text Generation • 2B • Updated Jul 5 • 321 • 4

Shiftedx/ornith-1.0-35b-mxfp4-vision-mtplx

Image-Text-to-Text • 35B • Updated 9 days ago • 644 • 1

shujunyi/Qwen3.5-4B-MTP-Q4_0

Text Generation • 4B • Updated Jul 5 • 102

siro1/glm-5.2-dspark-spec-v1

Text Generation • 4B • Updated about 1 month ago • 357

satgeze/Gemma4-12B-Uncensored-HauhauCS-1M-GGUF

Text Generation • 12B • Updated 27 days ago • 6.25k • 3

mitomtuna/MiMo-V2.5-DFlash-TP3

2B • Updated about 1 month ago • 26 • 1

vexp-ai/horizon-draft-0.5b

0.5B • Updated Jul 6 • 249 • 1

nota-ai/Qwen3.5-4B-DFlash-GPTQ-W4A16

Text Generation • 0.5B • Updated Jul 6 • 52 • 1

UCloud-org/GLM-5.2-FP8-DFlash

Text Generation • 4B • Updated 27 days ago • 2.69k • 9

thehosy/Qwen3.5-397B-A17B-MXFP4-MTP-BF16

222B • Updated Jul 6 • 451

jamiefutch/Ornith-1.0-9B-MTP-GGUF

Text Generation • 9B • Updated Jul 6 • 484

jamiefutch/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M

Text Generation • 39B • Updated Jul 6 • 268

satgeze/Gemma4-12B-Uncensored-HauhauCS-1.5M-GGUF

Text Generation • 12B • Updated 28 days ago • 3.69k • 3

avlp12/GLM-5.2-Alis-MLX-Dynamic-4.5bpw

Text Generation • 743B • Updated 14 days ago • 1.84k • 2

ox-ox/Hy3-295B-Instruct-w2q3exp-AProjQ8-SExpQ8-OutQ8-MTP-mlx

Text Generation • Updated about 1 month ago • 837 • 2