Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,314

Base only

Active filters: speculative-decoding

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-MLX-MTP-Drafter

0.4B • Updated Jun 28 • 2.55k • 2

tooltd/Qwen3.6-27B-MTP-TENSORS-ONLY-GGUF

0.4B • Updated Jun 27 • 151 • 1

christopher-kapic/AEON-Ultimate-ROCmFP4-Strix-Halo-GGUF

27B • Updated Jun 26 • 358 • 2

CosmicRaisins/GLM-5.2-MTP-INT4

11B • Updated Jun 23 • 58 • 1

EntityDeletr/North-Mini-Code-1.0-EAGLE3-GGUF

0.2B • Updated Jun 24 • 81

bleysg/Qwen3.5-122B-A10B-int4-fp8-hybrid

Text Generation • 20B • Updated Jun 24 • 46k • 7

EntityDeletr/Qwen3.6-35B-A3B-Caption-Eagle3DraftModel-GGUF

0.7B • Updated Jun 24 • 169

EntityDeletr/EAGLE3-gpt-oss-20b-GGUF

Text Generation • 0.4B • Updated Jun 24 • 142

markmonger/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-iMatrix-MTP-GGUF

Text Generation • 39B • Updated Jun 25 • 370

Mediform/gemma4-e4b-v13-assistant-rollout-gguf

78M • Updated Jun 24 • 29

nerkyor/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-FP8

Text Generation • 37B • Updated Jun 28 • 99 • 1

ji-farthing/Qwen3.5-35B-A3B-DFlash-SWA-ik-llama-GGUF

0.4B • Updated Jun 24 • 81

ji-farthing/gemma-4-26B-A4B-it-DFlash-SWA-ik-llama-GGUF

0.4B • Updated Jun 24 • 73

inference-optimization/dflash-DeepSeek-V4-Flash-all-swa-muon-speculators-50k

2B • Updated Jun 27 • 46 • 2

jcbtc/Chadrockv2-Qwen3.6-27B-ROCmFP6-STRIX-QUALITY

Text Generation • 27B • Updated Jun 24 • 190 • 5

jglowa/Bielik-11B-v3.0-DFlash-GGUF

Text Generation • 1B • Updated Jul 3 • 177

pyloxsystems/hochelaga-8b

Text Generation • 8B • Updated Jun 24 • 55 • 1

groxaxo/Qwen3.6-35B-A3B-Heretic-REAP-0.30-GPTQ-Pro-vLLM

Text Generation • 26B • Updated Jun 25 • 188 • 1

rdtand/Qwen3.6-27B-PrismaAURA-5.5bit-vllm

20B • Updated Jun 25 • 46.2k • 26

mradermacher/hochelaga-8b-GGUF

8B • Updated Jun 25 • 230 • 1

mradermacher/hochelaga-8b-i1-GGUF

8B • Updated Jun 25 • 970 • 1

inferencerlabs/GLM-5.2-MTP-MLX-Q4

Image-Text-to-Text • 2B • Updated Jun 25 • 3.63k • 7

Zhangdanyang/Kimi_K25_eagle3_v2_phase1_Lumen

3B • Updated Jun 25 • 13

jcbtc/Qwable-5-27B-Chadrock-v2-ROCmFP6-QUALITY

Text Generation • 27B • Updated Jun 25 • 127 • 1

keXjos/Qwen3.6-27B-DSV4Pro-Thinking-Distill-mlx-4Bit

Text Generation • 27B • Updated Jun 25 • 321 • 1

sant1an/GLM-5.2-NVFP4-MTP

Text Generation • Updated Jun 25 • 58 • 2

gangel/Bielik-11B-v3.0-DFlash-MLX-8bit

Text Generation • 0.4B • Updated Jun 25 • 167

mattbucci/Devstral-Small-2-24B-AWQ-EAGLE3

0.8B • Updated Jun 26 • 11

noctuashap/Confucius3-Math-DFlash

Feature Extraction • 2B • Updated Jun 26 • 16

novita/kimi-k2.7-code-eagle3-mla

Text Generation • 2B • Updated Jun 30 • 9.33k • 3