Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,487

Base only

Active filters: 3-bit

mlx-community/SmolLM3-3B-3bit

Text Generation • 0.4B • Updated Jul 8, 2025 • 20 • 2

mlx-community/SmolLM3-3B-Base-3bit

Text Generation • 0.4B • Updated Jul 8, 2025 • 15

irish-quant/Qwen-Qwen3-0.6B-3bit

0.6B • Updated Jul 8, 2025 • 8

irish-quant/Qwen-Qwen3-1.7B-3bit

2B • Updated Jul 8, 2025 • 14

irish-quant/Qwen-Qwen3-14B-3bit

14B • Updated Jul 8, 2025 • 8

irish-quant/Qwen-Qwen3-32B-3bit

31B • Updated Jul 8, 2025 • 6

irish-quant/Qwen-Qwen3-4B-3bit

4B • Updated Jul 8, 2025 • 5

irish-quant/Qwen-Qwen3-8B-3bit

8B • Updated Jul 8, 2025 • 3

figodeng/DeepSeek-R1-Distill-Llama-70B-3bit

9B • Updated Jul 11, 2025 • 3

steampunque/Llama-3.3-70B-Instruct-MP-GGUF

71B • Updated Feb 18 • 90

notname0192/dd

Image-Text-to-Text • 2B • Updated Jul 12, 2025 • 12

nafisabdkhan/DeepSeek-Coder-V2-Instruct-mlx-3Bit

30B • Updated Jul 14, 2025 • 83

elimelec1/Mistral-7B-Instruct-v0.3-mlx-3bit

Text Generation • 0.9B • Updated Jul 14, 2025 • 7

irish-quant/mistralai-Mistral-7B-Instruct-v0.3-3bit

7B • Updated Jul 15, 2025 • 7

irish-quant/mistralai-Mistral-7B-v0.3-3bit

7B • Updated Jul 15, 2025 • 5

beezu/StrawberryLemonade-70B-v1.1-MLX-3Bit

Text Generation • 71B • Updated Jul 17, 2025 • 6

mlx-community/Qwen3-235B-A22B-Instruct-2507-3bit

Text Generation • 235B • Updated Jul 22, 2025 • 48

bullerwins/Qwen3-235B-A22B-Instruct-2507-exl3-3.0bpw

Text Generation • 45B • Updated Jul 25, 2025 • 8 • 1

mlx-community/Qwen3-235B-A22B-Thinking-2507-3bit

Text Generation • 235B • Updated Jul 25, 2025 • 43 • 1

mlx-community/Qwen3-235B-A22B-Instruct-2507-3bit-DWQ

Text Generation • 235B • Updated Jul 26, 2025 • 105 • 5

mlx-community/Qwen3-235B-A22B-Thinking-2507-3bit-DWQ

Text Generation • 235B • Updated Jul 26, 2025 • 159 • 6

JonasWang/Llama-3.1-8B-Instruct-gptq-3bit-128g

8B • Updated Jul 27, 2025 • 4

zerofata/MS3.2-PaintedFantasy-v2-24b-exl3-3bpw

Text Generation • 5B • Updated Jul 31, 2025 • 4

bullerwins/Qwen3-235B-A22B-Thinking-2507-exl3-3.0bpw

Text Generation • 45B • Updated Jul 28, 2025 • 9

fengpeisheng1/saiga_nemo_12b-mlx-3Bit

2B • Updated Jul 28, 2025 • 10

fengpeisheng1/The-Omega-Directive-M-12B-Unslop-v2.0-mlx-3Bit

Text Generation • 2B • Updated Jul 28, 2025 • 11 • 1

fengpeisheng1/R1-8B-ArliAI-RpR-v2-mlx-3Bit

1B • Updated Jul 28, 2025 • 4

fengpeisheng1/14B-Qwen2.5-Kunou-v1-mlx-3Bit

Text Generation • 2B • Updated Jul 28, 2025 • 4

fengpeisheng1/14B-Qwen2.5-Freya-x1-mlx-3Bit

Text Generation • 2B • Updated Jul 28, 2025 • 9

fengpeisheng1/Mistral-Nemo-12B-ArliAI-RPMax-v1.3-mlx-3Bit

2B • Updated Jul 28, 2025 • 20