Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

181

Base only

Active filters: 2bit

JANGQ-AI/MiniMax-M2.7-JANGTQ

Text Generation • 15B • Updated May 5 • 1.18k • 43

majentik/gpt-oss-20b-TurboQuant-MLX-2bit

Text Generation • 21B • Updated 21 days ago • 687

majentik/gpt-oss-20b-RotorQuant-MLX-2bit

Text Generation • 21B • Updated 21 days ago • 356

OsaurusAI/MiniMax-M2.7-JANGTQ

Text Generation • 15B • Updated May 5 • 44 • 1

AngelSlim/Hy-MT1.5-1.8B-2bit

Translation • 2B • Updated Jun 23 • 6 • 11

AngelSlim/Hy-MT1.5-1.8B-2bit-GGUF

Translation • 2B • Updated Jun 23 • 140 • 23

tencent/Hy-MT1.5-1.8B-2bit-GGUF

Translation • 2B • Updated Apr 29 • 136 • 28

tencent/Hy-MT1.5-1.8B-2bit

Translation • 2B • Updated Apr 29 • 60 • 35

aoiandroid/Hy-MT1.5-1.8B-2bit-GGUF

Translation • 2B • Updated May 1 • 8

senjiangchen/Hy-MT1.5-1.8B-2bit

Translation • 2B • Updated May 1 • 5

JANGQ-AI/Hy3-preview-JANGTQ

Text Generation • 22B • Updated May 11 • 43

OsaurusAI/Hy3-preview-JANGTQ

Text Generation • 22B • Updated May 11 • 43

zjiayu064/Qwen3-30B-A3B-Base-BitsMoE-2bit

Text Generation • 4B • Updated Jun 3 • 39

zjiayu064/Qwen3-Next-80B-A3B-Instruct-BitsMoE-2bit

Text Generation • Updated Jun 3 • 20

zjiayu064/DeepSeek-V2-Lite-BitsMoE-2bit

Text Generation • 3B • Updated Jun 3 • 24

ekryski/Qwen3.5-0.8B-2bit

0.4B • Updated May 26 • 24

mlx-community/Qwen3.5-122B-A10B-OptiQ-2bit

Image-Text-to-Text • 122B • Updated 27 days ago • 1.03k • 4

mlx-community/NVIDIA-Nemotron-3-Super-120B-A12B-OptiQ-2bit

Text Generation • 121B • Updated about 1 month ago • 921 • 2

majentik/Ornith-1.0-35B-MLX-2bit

Image-Text-to-Text • 4B • Updated Jul 4 • 289

majentik/Qwen-AgentWorld-35B-A3B-MLX-2bit

Text Generation • 3B • Updated Jul 4 • 146 • 1

majentik/Qwen3-Coder-Next-MLX-2bit

Text Generation • 80B • Updated Jul 4 • 393

majentik/Qwen3.6-27B-MLX-2bit

Image-Text-to-Text • 3B • Updated about 19 hours ago • 208

sapidlabs/GLM-5.2-2bit-MoE-planes-pruned208-tp2

Text Generation • Updated 28 days ago • 2

9prodhi/DeepSeek-V4-Flash-moet2pf

Updated 28 days ago

MarkChen1214/cohere-transcribe-03-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 0.2B • Updated 23 days ago • 121 • 1

MarkChen1214/cohere-transcribe-arabic-07-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 0.2B • Updated 23 days ago • 265 • 1

JANGQ-AI/GLM-5.2-JANG_2L

Text Generation • 97B • Updated 12 days ago

mlx-community/Laguna-S-2.1-OptiQ-2bit

Text Generation • 118B • Updated 11 days ago • 470 • 2

9prodhi/Qwen3.6-35B-A3B-moet2pf

Text Generation • Updated 1 day ago

mlx-community/Hy3-OptiQ-2bit

Text Generation • 24B • Updated 4 days ago • 184