Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

speculative-decoding

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

723

Base only

Active filters: speculative-decoding

weijiezz/EAGLE3-Llama-3.1-8B-Instruct

0.4B • Updated May 11 • 4

eric717273/Qwen3.5-122B-A10B-MXFP4_MOE-MTP-GGUF

Text Generation • 125B • Updated May 13 • 345 • 1

namenotfoundai/NNF-EAM

Text Generation • Updated 18 days ago • 26 • 3

Kevpadil/Qwen3.6-35B-A3B-PrismaQuant-4.75bit-vllm

Image-Text-to-Text • 21B • Updated May 12 • 8

tnhnyzc/MiMO-V2.5-MTP-GGUF

Text Generation • 310B • Updated May 12 • 103 • 3

ji-farthing/gemma-4-26B-A4B-it-assistant-Q4_K_S-GGUF

0.4B • Updated May 13 • 213

shdennlin/gemma-4-26B-A4B-it-8bit

Image-Text-to-Text • 8B • Updated May 13 • 25

shdennlin/gemma-4-26B-A4B-it-assistant-8bit

Image-Text-to-Text • 0.1B • Updated May 13 • 54

bahadirakdemir/gemma-4-31B-it-assistant-fp8

Text Generation • 0.5B • Updated May 13 • 195 • 2

sleepyeldrazi/Qwen3.6-27B-MXFP4-MTP

Image-Text-to-Text • 6B • Updated May 13 • 195

ji-farthing/gemma-4-26B-A4B-it-assistant-Q6_K-GGUF

0.4B • Updated May 13 • 271 • 1

GazTrab/Qwen3.6-27B-MTP-UD-IQ3_XXS-GGUF

Text Generation • 27B • Updated May 13 • 436

GestaltLabs/Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF

Image-Text-to-Text • 27B • Updated May 14 • 1.59k • 12

grteam/Qwen3.6-35B-A3B-GRTEAM-MTP-Q5_K_M

Text Generation • 36B • Updated May 13 • 22

zan/Qwen3.6-27B-DFlash-ja

Text Generation • 2B • Updated May 14 • 56

amd/Kimi-K2.5-Eagle3-FP8

3B • Updated about 22 hours ago • 220

hardik-xi11/gemma-4-31B-it-DFlash

Text Generation • 2B • Updated May 14 • 77

sleepyeldrazi/Qwen3.5-4B-MXFP4-MTP

Image-Text-to-Text • 0.8B • Updated May 15 • 260 • 1

sleepyeldrazi/Qwen3.5-9B-MXFP4-MTP

Image-Text-to-Text • 2B • Updated May 15 • 438 • 1

gaston-parravicini/Qwen3.6-27B-Abliterated-MTP-GGUF

27B • Updated May 17 • 1.93k • 9

StentorLabs/Stentor3-20M

Text Generation • 20.3M • Updated May 20 • 242 • 6

Shankara-A-S/voxtral-mini-4b-asr-specdec

Automatic Speech Recognition • Updated 15 days ago • 557

connorhzp/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS

Text Generation • 17B • Updated May 15 • 58

coolthor/Huihui-gemma-4-26B-A4B-it-abliterated-eagle3-draft

0.9B • Updated 25 days ago • 53 • 1

originalGeek/Qwen3.6-27B-unsloth-MTP-Q8_0-HEAD-ONLY

Updated about 1 month ago • 182 • 3

samwang0041/Qwen3.6-27B-MLX-4bit-MTP

Text Generation • 27B • Updated May 16 • 389 • 1

Incarnas/Qwen3.5-122B-A10B-NVFP4-MTP-GGUF

Image-Text-to-Text • 125B • Updated May 20 • 877 • 1

mudler/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-APEX-MTP-GGUF

36B • Updated May 21 • 2.29k • 6

mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-MTP-GGUF

36B • Updated May 21 • 9.57k • 20

mudler/Qwopus3.6-35B-A3B-v1-APEX-MTP-GGUF

36B • Updated May 21 • 11.9k • 16