Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,486

Base only

Active filters: 3-bit

mlx-community/exaone-4.0-32b-3bit

Text Generation • 32B • Updated Jul 31, 2025 • 15

mlx-community/Qwen3-Coder-30B-A3B-Instruct-3bit

Text Generation • 31B • Updated Jul 31, 2025 • 715 • 2

federicoramos77/Phi-3.5-mini-instruct-mlx-3Bit

Text Generation • 0.5B • Updated Aug 1, 2025 • 7

federicoramos77/Hermes-3-Llama-3.2-3B-mlx-3Bit

Text Generation • 0.4B • Updated Aug 1, 2025 • 21

federicoramos77/Phi-3-mini-4k-instruct-mlx-3Bit

Text Generation • 0.5B • Updated Aug 1, 2025 • 7

zerofata/MS3.2-PaintedFantasy-Visage-v2-33B-exl3-3bpw

Text Generation • 7B • Updated Aug 3, 2025 • 4

DeusImperator/L3.3-Shakudo-70b_exl3_3.0bpw_H6

14B • Updated Aug 6, 2025 • 8

NexVeridian/Qwen3-Coder-30B-A3B-Instruct-3bit

Text Generation • 31B • Updated Aug 8, 2025 • 59

bullerwins/GLM-4.5-exl3-3.0bpw

Text Generation • 67B • Updated Aug 10, 2025 • 9

beezu/Irixxed-Magcap-12B-Slerp-MLX-3Bit

Text Generation • 2B • Updated Aug 10, 2025 • 3

SicariusSicariiStuff/Impish_Nemo_12B_EXL3_3.0bpw

Text Generation • 3B • Updated Aug 10, 2025 • 6

beezu/Violet_Magcap-12B-MLX-3Bit

Text Generation • 2B • Updated Aug 11, 2025 • 11

mlx-community/GLM-4.5V-3bit

Updated Aug 11, 2025 • 32 • 1

monirmamoun/GLM-4.5-MLX-3bit

Text Generation • 353B • Updated Aug 12, 2025 • 15

mlx-community/GLM-4.5-Air-3bit-DWQ-v2

Text Generation • 107B • Updated Aug 13, 2025 • 73 • 4

QuantTrio/Seed-OSS-36B-Instruct-GPTQ-Int3

Text Generation • 34B • Updated Sep 15, 2025 • 25 • 3

mlx-community/moonshotai_Kimi-K2-Instruct-mlx-3bit

Text Generation • 1T • Updated Aug 23, 2025 • 727 • 2

Downtown-Case/ByteDance-Seed_Seed-OSS-36B-Instruct-exl3-3.22bpw-hb6

Text Generation • 8B • Updated Aug 24, 2025 • 17 • 1

Downtown-Case/ByteDance-Seed_Seed-OSS-36B-Base-woSyn-exl3-3.22bpw-hb6

Text Generation • 8B • Updated Aug 22, 2025 • 6

mrtoots/unsloth-GLM-4.5-MLX-3Bit

Text Generation • 353B • Updated Sep 1, 2025 • 58 • 1

hehua2008/GLM-4.5V-abliterated-MLX-3bit

Updated Aug 24, 2025 • 6

isogen/Mistral-Small-Instruct-2409-exl3-3bpw

4B • Updated Aug 24, 2025 • 4

mlx-community/GLM-4.5V-abliterated-3bit

Updated Aug 24, 2025 • 8

zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-3bpw

7B • Updated Aug 30, 2025 • 3

MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 27, 2025 • 194k • 3

MaziyarPanahi/Qwen3-30B-A3B-Instruct-2507-GGUF

Text Generation • 31B • Updated Nov 20, 2025 • 104k • 4

beezu/Evathene-v1.2-MLX-3Bit

Text Generation • 73B • Updated Sep 5, 2025 • 5

mlx-community/Kimi-K2-Instruct-0905-mlx-3bit

Text Generation • 1T • Updated Sep 6, 2025 • 347 • 2

mlx-community/Klear-46B-A2.5B-Instruct-3bit

Text Generation • 46B • Updated Sep 8, 2025 • 23

mrtoots/unsloth-Hermes-4-405B-mlx-3Bit

Text Generation • 406B • Updated Sep 11, 2025 • 62