Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,169

Base only

Active filters: speculative-decoding

guardiangate1775/gemma-4-26B-A4B-it-assistant-4bit

Text Generation • 0.4B • Updated May 6 • 72 • 1

Dyluhn/lordx64-Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-MTP-GGUF

Text Generation • 36B • Updated May 6 • 230 • 15

guardiangate1775/gemma-4-26B-A4B-it-assistant-8bit

Text Generation • 0.4B • Updated May 6 • 35

localweights/Qwen3.6-35B-A3B-MTP-IMAT-IQ4_XS-Q8nextn-GGUF

Text Generation • 36B • Updated Jul 16 • 603 • 4

dayngerous/CASM

Updated May 7 • 8

dxx117/Qwen3.5-397B-A17B-heretic-GGUF-v2-MTP

403B • Updated May 22 • 136 • 1

HackAfterDark/gemma-4-e4b-it-mtp-assistant-ultralight

0.4B • Updated May 7 • 502 • 13

Blongo1/gemma4-mtp-bench

localweights/Qwen3.6-35B-A3B-MTP-BF16-GGUF

Text Generation • 36B • Updated May 7 • 72 • 1

guru87/Qwen3.6-27B-MTP

Updated May 7 • 3

poolside/Laguna-XS.2-speculator.dflash

0.6B • Updated May 19 • 213 • 9

guru87/Qwen3.5-0.8B-MTP

guru87/Qwen3.5-2B-MTP

Updated May 7 • 1

guru87/Qwen3.5-4B-MTP

guru87/Qwen3.5-9B-MTP

SteadyVictor/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 19B • Updated May 7 • 30

RedHatAI/Qwen3-8B-speculator.dflash

2B • Updated 22 days ago • 403 • 12

starskyzheng/Qwen3.6-35B-DFlash-GGUF

0.5B • Updated May 8 • 241 • 1

ericpandev/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-bf16

Image-Text-to-Text • 35B • Updated May 9 • 3.03k • • 6

localweights/Qwen3.6-27B-MTP-IMAT-IQ4_XS-Q8nextn-GGUF

Text Generation • 27B • Updated Jul 16 • 279 • 8

cafkafk/gemma-4-E2B-it-assistant-GGUF-noimatrix

78M • Updated May 8 • 539 • 2

cafkafk/gemma-4-E4B-it-assistant-GGUF-noimatrix

78.8M • Updated May 8 • 516 • 3

cafkafk/gemma-4-26B-A4B-it-assistant-GGUF-noimatrix

0.4B • Updated May 8 • 1.02k • 2

cafkafk/gemma-4-31B-it-assistant-GGUF-noimatrix

0.5B • Updated May 8 • 612 • 8

adasdadsd/smallq-flash-attention-ascend

z-lab/MiniMax-M2.7-DFlash

Text Generation • 0.6B • Updated Jun 25 • 28

QuixiAI/Qwen3.6-27B-DFlash

Text Generation • 2B • Updated May 9 • 24 • 3

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed-FP16

27B • Updated 21 days ago • 429 • 11

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Quality

Image-Text-to-Text • 27B • Updated 21 days ago • 568 • 15

Lucebox/Qwen3.6-27B-DFlash-GGUF

2B • Updated May 28 • 143 • 14