Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

speculative-decoding

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

723

Base only

Active filters: speculative-decoding

Blongo1/gemma4-mtp-bench

AtomicChat/gemma-4-E2B-it-assistant-GGUF

Text Generation • 78M • Updated May 7 • 3.38k • 7

AtomicChat/gemma-4-E4B-it-assistant-GGUF

Text Generation • 78.8M • Updated May 7 • 7.02k • 18

AtomicChat/gemma-4-26B-A4B-it-assistant-GGUF

Text Generation • 0.4B • Updated May 7 • 12.9k • 28

AtomicChat/gemma-4-31B-it-assistant-GGUF

Text Generation • 0.5B • Updated May 7 • 7.49k • 16

localweights/Qwen3.6-35B-A3B-MTP-BF16-GGUF

Text Generation • 36B • Updated May 7 • 152

guru87/Qwen3.5-0.8B-MTP

guru87/Qwen3.5-2B-MTP

Updated May 7 • 1

guru87/Qwen3.5-4B-MTP

guru87/Qwen3.5-9B-MTP

SteadyVictor/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 19B • Updated May 7 • 67

RedHatAI/Qwen3-8B-speculator.dflash

2B • Updated May 7 • 923 • 12

starskyzheng/Qwen3.6-35B-DFlash-GGUF

0.5B • Updated May 8 • 365 • 1

ericpandev/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-bf16

Image-Text-to-Text • 35B • Updated May 9 • 674 • 3

localweights/Qwen3.6-27B-MTP-IMAT-IQ4_XS-Q8nextn-GGUF

Text Generation • 27B • Updated May 16 • 345 • 5

cafkafk/gemma-4-E2B-it-assistant-GGUF-noimatrix

78M • Updated May 8 • 603 • 2

cafkafk/gemma-4-E4B-it-assistant-GGUF-noimatrix

78.8M • Updated May 8 • 819 • 3

cafkafk/gemma-4-26B-A4B-it-assistant-GGUF-noimatrix

0.4B • Updated May 8 • 1.2k • 2

cafkafk/gemma-4-31B-it-assistant-GGUF-noimatrix

0.5B • Updated May 8 • 1.08k • 8

adasdadsd/smallq-flash-attention-ascend

QuixiAI/Qwen3.6-27B-DFlash

Text Generation • 2B • Updated May 9 • 125 • 2

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed-FP16

5B • Updated 20 days ago • 3.49k • 7

Lucebox/Qwen3.6-27B-DFlash-GGUF

Updated 30 days ago • 2.71k • 10

LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8

Text Generation • 44B • Updated May 11 • 1.62k • 14

litcloud/Qwen3.6-27B-Text-NVFP4-MTP

Text Generation • 17B • Updated May 10 • 815 • 1

dxx117/Qwen3.5-397B-A17B-GGUF-UD-IQ2_XXS-MTP-Q8_0

403B • Updated May 10 • 11

liamkou/gemma-4-26B-A4B-it-assistant-bf16

Text Generation • 0.4B • Updated May 11 • 64

weijiezz/SpecBlock-Qwen3-8B

0.7B • Updated May 11 • 3

weijiezz/SpecBlock-Llama-3.1-8B-Instruct

0.7B • Updated May 11 • 4

weijiezz/EAGLE3-Llama-3.1-8B-Instruct

0.4B • Updated May 11 • 4