Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,211

Base only

Active filters: 3-bit

quantpa/Qwen__Qwen3-4B-Thinking-2507_RTN_w3g128

4B • Updated Jan 21 • 1

quantpa/Qwen__Qwen3-30B-A3B-Thinking-2507_RTN_w3g128

31B • Updated Jan 21 • 1

quantpa/microsoft__Phi-4-reasoning-plus_RTN_w3g128

15B • Updated Jan 21 • 2

quantpa/zai-org__GLM-Z1-9B-0414_RTN_w3g128

9B • Updated Jan 21 • 1

NexVeridian/GLM-4.7-Flash-REAP-23B-A3B-3bit

Text Generation • 23B • Updated Feb 17 • 53 • 1

NexVeridian/Qwen3-Coder-Next-3bit

Text Generation • 80B • Updated Feb 13 • 209

RESMP-DEV/GLM-4.7-Flash-Trellis-MM

Text Generation • 14B • Updated Feb 5 • 1 • 1

AutisticAF/Qwen3-Coder-Next-mlx-3Bit

Text Generation • 80B • Updated Feb 6 • 115

nanzhang/QuantLRM-R1-Qwen-32B-3-bit

Text Generation • 33B • Updated Feb 11 • 3

nanzhang/QuantLRM-R1-Llama-70B-3-bit

Text Generation • 71B • Updated Feb 11 • 1

Open4bits/granite-4.0-micro-mlx-3Bit

Text Generation • 0.4B • Updated Feb 11 • 17

nanzhang/QuantLRM-R1-Qwen3-8B-3-bit

Text Generation • 8B • Updated Feb 11

nanzhang/QuantLRM-Olmo-3-7B-Think-DPO-3-bit

Text Generation • 7B • Updated Feb 11 • 1

nanzhang/QuantLRM-Olmo-3-7B-Think-3-bit

Text Generation • 7B • Updated Feb 11 • 1

FlimsyFox/Mistral-Nemo-Inst-2407-12B-Thinking-Uncensored-HERETIC-HI-Claude-Opus-mlx-3Bit-rk3588-1.1.2

Text Generation • Updated Feb 9 • 173

MaziyarPanahi/Schematron-3B-GGUF

Text Generation • 3B • Updated Feb 10 • 104

MaziyarPanahi/VulnLLM-R-7B-GGUF

Text Generation • 8B • Updated Feb 10 • 91

MaziyarPanahi/EXAONE-4.0-1.2B-GGUF

Text Generation • 1B • Updated Feb 10 • 141

MaziyarPanahi/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated Feb 10 • 79.9k • 1

petergilani/Qwen3-Coder-Next-3bit-g128

Text Generation • 80B • Updated Feb 11 • 6 • 1

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W3A16

1B • Updated Feb 11 • 2

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W3A16-EoRA

1B • Updated Feb 12 • 2

badmadrad/Devstral-Small-2-24B-Instruct-2512-MLX-3bit

Text Generation • 24B • Updated Feb 13 • 151

mlx-community/MiniMax-M2.5-3bit

Text Generation • 229B • Updated Feb 13 • 493 • 11

TomLucidor/Qwen3-Coder-Next-REAM-mlx-3Bit

Text Generation • 60B • Updated Feb 13 • 276 • 2

catalystsec/MiniMax-M2.5-3bit-DWQ

Text Generation • 229B • Updated Feb 20 • 34

thedarkstar/Magidonia-24B-v4.3-mlx-3Bit

Text Generation • 24B • Updated Feb 21 • 6

NexVeridian/Qwen3.5-35B-A3B-3bit

Text Generation • 35B • Updated Feb 24 • 96 • 2

MaziyarPanahi/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated Feb 24 • 108 • 2

NexVeridian/Qwen3.5-27B-3bit

Text Generation • 27B • Updated Feb 25 • 142 • 1