Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,309

Base only

Active filters: speculative-decoding

a4lg/Qwen3.5-27B-MTP-ONLY-GGUF

3B • Updated Jun 30 • 164 • 1

a4lg/Qwen3.6-35B-A3B-MTP-ONLY-GGUF

2B • Updated Jun 30 • 1.55k

a4lg/Qwen3.6-27B-MTP-ONLY-GGUF

3B • Updated Jun 30 • 338 • 2

a4lg/Qwen3.5-397B-A17B-MTP-ONLY-GGUF

9B • Updated Jun 30 • 214

a4lg/Qwen3.5-122B-A10B-MTP-ONLY-GGUF

4B • Updated Jun 30 • 458 • 3

ankk98/dspark-qwen3-8b-block7-Q4_K_M-GGUF

2B • Updated Jun 30 • 1.33k • 3

williamliao/gemma-4-31B-it-DFlash-GGUF

Text Generation • 2B • Updated Jun 30 • 736 • 1

williamliao/gemma-4-26B-A4B-it-DFlash-GGUF

Text Generation • 0.4B • Updated 25 days ago • 1.23k

williamliao/Qwen3.6-35B-A3B-NVFP4-GGUF

Text Generation • 36B • Updated 25 days ago • 689 • 3

a4lg/Qwen3.5-9B-MTP-ONLY-GGUF

2B • Updated Jun 30 • 282

onion515/ornith-9b-dflash

Text Generation • 1B • Updated Jun 30 • 537 • 1

neko-legends/Qwen3.6-35B-A3B-NVFP4-MTP-GGUF

Text Generation • 36B • Updated 19 days ago • 14.9k • 4

utautako/Qwen3.6-27B-NVIDIA-NVFP4-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated 23 days ago • 7.22k • 11

onion515/Qwen3.5-9B-DFlash-GGUF

Text Generation • 1B • Updated Jul 1 • 732

nwzjk/MiniMax-M3-EAGLE3-Duplicated

Text Generation • 3B • Updated Jul 1 • 16

EntityDeletr/Qwen3.5-9B-DFlash-GGUF

1B • Updated Jul 1 • 131

EntityDeletr/gpt-oss-20b-DFlash-GGUF

0.8B • Updated Jul 1 • 672 • 1

williamliao/Gemma-4-26B-A4B-NVFP4-GGUF

Text Generation • 25B • Updated 25 days ago • 676

bannert/tmax-27b-AWQ-BF16-INT4

Text Generation • 29B • Updated Jul 1 • 387

williamliao/Gemma-4-31B-NVFP4-GGUF

Image-Text-to-Text • 32B • Updated Jul 1 • 3.36k

programmer-666/Ornith-1.0-35B-MLX-oQ7

Text Generation • 35B • Updated 26 days ago • 872 • 3

s-batman/Agents-A1-NVFP4-MTP-GGUF

Image-Text-to-Text • 36B • Updated Jul 1 • 8.25k • 15

pablogrant/ORNITH-1.0_35B_AEON_PABLOG-OPTIMIZED_UNCENSORED_DSPARK-DRAFT_BF16

Text Generation • 0.8B • Updated Jul 1 • 188 • 4

pablogrant/ORNITH-1.0_35B_AEON_PABLOG-OPTIMIZED_UNCENSORED_DSPARK-DRAFT_NVFP4

Text Generation • 0.8B • Updated Jul 1 • 248 • 4

Jim-and-HF/Qwen3.6-27B-MXFP4-MTP

Image-Text-to-Text • 6B • Updated Jul 1 • 156 • 1

RedHatAI/Qwen3.5-397B-A17B-speculator.dflash

2B • Updated 16 days ago • 287 • 3

pablogrant/ORNITH-1.0_35B_AEON_PABLOG-OPTIMIZED_UNCENSORED_BF16

Text Generation • 35B • Updated Jul 1 • 334 • 1

pablogrant/ORNITH-1.0_35B_AEON_PABLOG-OPTIMIZED_UNCENSORED_NVFP4

Text Generation • 21B • Updated Jul 1 • 527

fraserprice/Ornith-1.0-397B-W4A16-AutoRound-DFlash

Text Generation • Updated Jul 2 • 1k

RedTeamLab/Qwen3.6-27B-redteam-v5

27B • Updated Jul 3 • 888 • 4