Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,156

Base only

Active filters: speculative-decoding

avlp12/GLM-5.2-Alis-MLX-Dynamic-3.5bpw

Text Generation • 751B • Updated Jul 24 • 318 • 5

avlp12/GLM-5.2-Alis-MLX-Dynamic-2.56bpw

Text Generation • 751B • Updated Aug 28 • 180 • 2

PatrickScully/Qwen3.6-27B-MTP-pi-reasoning-ROCmFP4-GGUF

Text Generation • 27B • Updated Jun 21 • 28

claymorecrystal/Qwen3.6-27B-PRISM-PRO-DQ

Text Generation • 27B • Updated Jun 21 • 47

SC117/QwenPaw-Flash-9B-MTP-GGUF

0.5B • Updated 4 days ago • 1.09k • 5

OpenYourMind/Kimi-K2.7-coder-DFLASH-preview

1.0B • Updated Jun 22 • 1

nerkyor/Qwen3.6-27B-DSV4Pro-Thinking-Distill

Text Generation • 27B • Updated Jun 28 • 928 • 16

CosmicRaisins/GLM-5.2-MTP-INT4-15pct

Text Generation • 9B • Updated Jun 23 • 26 • 5

SixVolts/GLM-5.2-ewaste-edition-GGUF

Text Generation • 754B • Updated 6 days ago • 330 • 15

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jul 2 • 268 • 1

nerkyor/Qwen3.6-27B-DSV4Pro-Thinking-Distill-FP8

Text Generation • 28B • Updated Jun 28 • 54 • 5

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit

Image-Text-to-Text • 27B • Updated 1 day ago • 7.2k • 6

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-FP4

Image-Text-to-Text • 27B • Updated 1 day ago • 7.21k • 2

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-MLX-MTP-Drafter

0.4B • Updated 1 day ago • 1.45k • 3

tooltd/Qwen3.6-27B-MTP-TENSORS-ONLY-GGUF

0.4B • Updated Jun 27 • 41 • 2

christopher-kapic/AEON-Ultimate-ROCmFP4-Strix-Halo-GGUF

27B • Updated Jun 26 • 101 • 3

CosmicRaisins/GLM-5.2-MTP-INT4

11B • Updated Jun 23 • 21 • 1

EntityDeletr/North-Mini-Code-1.0-EAGLE3-GGUF

0.2B • Updated Jun 24 • 88

bleysg/Qwen3.5-122B-A10B-int4-fp8-hybrid

Text Generation • 20B • Updated Jun 24 • 5.82k • 9

EntityDeletr/Qwen3.6-35B-A3B-Caption-Eagle3DraftModel-GGUF

0.7B • Updated Jun 24 • 270

EntityDeletr/EAGLE3-gpt-oss-20b-GGUF

Text Generation • 0.4B • Updated Jun 24 • 283

markmonger/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-iMatrix-MTP-GGUF

Text Generation • 39B • Updated Jun 25 • 73

nerkyor/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-FP8

Text Generation • 37B • Updated Jun 28 • 28 • 1

ji-farthing/Qwen3.5-35B-A3B-DFlash-SWA-ik-llama-GGUF

0.4B • Updated Jun 24 • 96 • 1

ji-farthing/gemma-4-26B-A4B-it-DFlash-SWA-ik-llama-GGUF

0.4B • Updated Jun 24 • 135 • 1

inference-optimization/dflash-DeepSeek-V4-Flash-all-swa-muon-speculators-50k

2B • Updated Jun 27 • 81 • 2

jcbtc/Chadrockv2-Qwen3.6-27B-ROCmFP6-STRIX-QUALITY

Text Generation • 27B • Updated Jun 24 • 57 • 5

jglowa/Bielik-11B-v3.0-DFlash-GGUF

Text Generation • 1B • Updated Jul 3 • 254

pyloxsystems/hochelaga-8b

Text Generation • 8B • Updated Jun 24 • 25 • 1

groxaxo/Qwen3.6-35B-A3B-Heretic-REAP-0.30-GPTQ-Pro-vLLM

Text Generation • 26B • Updated Aug 22 • 398 • 1