Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

inference-acceleration

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

19

Base only

Active filters: inference-acceleration

ewinregirgojr/minicpm5-stock-analyst-v2-mtp

Text Generation • 1B • Updated Jul 5 • 314 • 2

davisliu/Qwen3.6-27B-MXFP4-VL-MTP

Image-Text-to-Text • 6B • Updated 17 days ago • 138 • 1

davisliu/Qwen3.8-27B-MXFP4-VL-MTP

Image-Text-to-Text • 6B • Updated 3 days ago • 445 • 1

HathoraResearch/qwen3_30b_moe_eagle3-ultra-1k-sample

0.2B • Updated Sep 10, 2025 • 21 • 2

nebius/MEDUSA-Llama-3.1-8B-Instruct

Text Generation • 3B • Updated May 27 • 20

nebius/MLP-Speculator-Llama-3.1-8B-Instruct

Text Generation • 0.2B • Updated May 27 • 11

nebius/EAGLE3-Llama-3.1-8B-Instruct

Text Generation • 0.4B • Updated May 27 • 163

nebius/EAGLE3-Llama-3.3-70B-Instruct

Text Generation • 1B • Updated May 27 • 3.3k

nebius/EAGLE3-gpt-oss-20b

Text Generation • 0.4B • Updated May 27 • 9.92k

nebius/EAGLE3-gpt-oss-120b

Text Generation • 0.4B • Updated May 27 • 1.23k

nebius/EAGLE3-Qwen3-235B-A22B-Instruct-2507

Text Generation • 0.6B • Updated May 27 • 26

nebius/MTP-DeepSeek-V3-0324

Text Generation • 13B • Updated May 27 • 28 • 3

AICP-Labs/qwen3-32b-dflash-en-zh

Text Generation • 0.5B • Updated Mar 1 • 90 • 3

Thr45h/MEDUSA-Llama-3.1-8B-Instruct

Text Generation • 3B • Updated Mar 17 • 12

samwang0041/Qwen3.6-27B-MLX-4bit-MTP

Text Generation • 27B • Updated May 16 • 740 • 6

DrCubix/aevox-diffusion-drafter-nemotron3-super

Updated Jun 12 • 7

EntityDeletr/EAGLE3-gpt-oss-20b-GGUF

Text Generation • 0.4B • Updated Jun 24 • 151

FINAL-Bench/Qwen3.5-35B-A3B-VKAE

Text Generation • Updated 27 days ago • 39

FINAL-Bench/Darwin-36B-Opus-VKAE

Text Generation • Updated Jul 4 • 34