Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,972

Full-text search

Active filters: 3-bit

JonasWang/Llama-3.1-8B-Instruct-gptq-3bit-128g

8B • Updated Jul 27, 2025

zerofata/MS3.2-PaintedFantasy-v2-24b-exl3-3bpw

Text Generation • 5B • Updated Jul 31, 2025 • 2

bullerwins/Qwen3-235B-A22B-Thinking-2507-exl3-3.0bpw

Text Generation • 45B • Updated Jul 28, 2025 • 2

fengpeisheng1/saiga_nemo_12b-mlx-3Bit

2B • Updated Jul 28, 2025 • 1

fengpeisheng1/The-Omega-Directive-M-12B-Unslop-v2.0-mlx-3Bit

Text Generation • 2B • Updated Jul 28, 2025 • 9 • 1

fengpeisheng1/R1-8B-ArliAI-RpR-v2-mlx-3Bit

1B • Updated Jul 28, 2025 • 3

fengpeisheng1/14B-Qwen2.5-Kunou-v1-mlx-3Bit

Text Generation • 2B • Updated Jul 28, 2025 • 2

fengpeisheng1/14B-Qwen2.5-Freya-x1-mlx-3Bit

Text Generation • 2B • Updated Jul 28, 2025 • 3

fengpeisheng1/Mistral-Nemo-12B-ArliAI-RPMax-v1.3-mlx-3Bit

2B • Updated Jul 28, 2025 • 30

mlx-community/GLM-4.5-Air-3bit

Text Generation • 107B • Updated Jul 28, 2025 • 300 • 31

mlx-community/GLM-4.5-Air-3bit-DWQ

Text Generation • 107B • Updated Jul 29, 2025 • 58 • 4

NexVeridian/EXAONE-4.0-1.2B-3bit

Text Generation • 0.2B • Updated Jul 30, 2025 • 5

NexVeridian/Harbinger-24B-3bit

Text Generation • 24B • Updated Jul 30, 2025 • 9

NexVeridian/Qwen3-30B-A3B-Instruct-2507-3bit

Text Generation • 31B • Updated Aug 18, 2025 • 15

NexVeridian/Qwen3-30B-A3B-Thinking-2507-3bit

Text Generation • 31B • Updated Aug 18, 2025 • 20

mlx-community/exaone-4.0-32b-3bit

Text Generation • Updated Jul 31, 2025 • 7

federicoramos77/Phi-3.5-mini-instruct-mlx-3Bit

Text Generation • 0.5B • Updated Aug 1, 2025 • 9

federicoramos77/Hermes-3-Llama-3.2-3B-mlx-3Bit

Text Generation • 0.4B • Updated Aug 1, 2025 • 9

federicoramos77/Phi-3-mini-4k-instruct-mlx-3Bit

Text Generation • 0.5B • Updated Aug 1, 2025 • 9

zerofata/MS3.2-PaintedFantasy-Visage-v2-33B-exl3-3bpw

Text Generation • 7B • Updated Aug 3, 2025 • 4

nightmedia/Huihui-Qwen3-Coder-30B-A3B-Instruct-abliterated-dwq3-mlx

Text Generation • 31B • Updated Aug 4, 2025 • 149

DeusImperator/L3.3-Shakudo-70b_exl3_3.0bpw_H6

14B • Updated Aug 6, 2025

NexVeridian/Qwen3-Coder-30B-A3B-Instruct-3bit

Text Generation • 31B • Updated Aug 8, 2025 • 362

cs2764/DeepSeek-V3-0324-BF16-mlx-3Bit-gs32

Text Generation • 671B • Updated Aug 6, 2025 • 23

NexVeridian/Qwen3-4B-Instruct-2507-3bit

Text Generation • 0.5B • Updated Aug 12, 2025 • 5

NexVeridian/Qwen3-4B-Thinking-2507-3bit

Text Generation • 0.5B • Updated Aug 26, 2025 • 9

cs2764/DeepSeek-R1-0528-BF16-mlx-3Bit-gs32

Text Generation • 671B • Updated Aug 6, 2025 • 16

NexVeridian/Seed-Coder-8B-Instruct-3bit

Text Generation • 1B • Updated Aug 6, 2025 • 10

bullerwins/GLM-4.5-exl3-3.0bpw

Text Generation • 67B • Updated Aug 10, 2025 • 3

beezu/Irixxed-Magcap-12B-Slerp-MLX-3Bit

Text Generation • 2B • Updated Aug 10, 2025 • 4