Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,953

Full-text search

Active filters: 3-bit

QuantTrio/Seed-OSS-36B-Instruct-GPTQ-Int3

Text Generation • 34B • Updated Sep 15, 2025 • 5 • 3

mlx-community/moonshotai_Kimi-K2-Instruct-mlx-3bit

Text Generation • Updated Aug 23, 2025 • 248 • 1

Downtown-Case/ByteDance-Seed_Seed-OSS-36B-Instruct-exl3-3.22bpw-hb6

Text Generation • 8B • Updated Aug 24, 2025 • 3 • 1

Downtown-Case/ByteDance-Seed_Seed-OSS-36B-Base-woSyn-exl3-3.22bpw-hb6

Text Generation • 8B • Updated Aug 22, 2025 • 1

mrtoots/unsloth-GLM-4.5-MLX-3Bit

Text Generation • 353B • Updated Sep 1, 2025 • 41 • 1

hehua2008/GLM-4.5V-abliterated-MLX-3bit

Updated Aug 24, 2025 • 3

isogen/Mistral-Small-Instruct-2409-exl3-3bpw

4B • Updated Aug 24, 2025

mlx-community/GLM-4.5V-abliterated-3bit

Updated Aug 24, 2025

zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-3bpw

7B • Updated Aug 30, 2025 • 1

MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 27, 2025 • 134k • 1

MaziyarPanahi/Qwen3-30B-A3B-Instruct-2507-GGUF

Text Generation • 31B • Updated Nov 20, 2025 • 72.9k • 4

beezu/Evathene-v1.2-MLX-3Bit

Text Generation • 73B • Updated Sep 5, 2025 • 2

mlx-community/Kimi-K2-Instruct-0905-mlx-3bit

Text Generation • 1T • Updated Sep 6, 2025 • 96 • 1

NexVeridian/Nova-70B-Llama-3.3-3bit

Text Generation • 71B • Updated Sep 7, 2025 • 18

mlx-community/Klear-46B-A2.5B-Instruct-3bit

Text Generation • 46B • Updated Sep 8, 2025 • 6

mrtoots/unsloth-Hermes-4-405B-mlx-3Bit

Text Generation • 406B • Updated Sep 11, 2025 • 16

NexVeridian/Qwen3-Next-80B-A3B-Instruct-3bit

Text Generation • 80B • Updated Dec 25, 2025 • 58 • 1

mlx-community/NousResearch_Hermes-4-14B-BF16-abliterated-mlx

Text Generation • Updated Sep 16, 2025 • 38 • 1

goooop/UI-Venus-Ground-72B-3bit-GPTQ

69B • Updated Sep 16, 2025

beezu/Behemoth-ReduX-123B-v1-MLX-3Bit

Text Generation • 123B • Updated Sep 16, 2025 • 4

NexVeridian/Qwen3-Next-80B-A3B-Thinking-3bit

Text Generation • 80B • Updated Dec 25, 2025 • 86 • 2

tensorbanana/vibevoice-7b-exl3-3bit

Updated Sep 19, 2025

Wwayu/Behemoth-ReduX-123B-v1-mlx-3Bit

Updated Sep 19, 2025 • 4

mlx-community/Ling-mini-2.0-3bit

Text Generation • 16B • Updated Sep 21, 2025 • 2

mrtoots/unsloth-DeepSeek-V3.1-Terminus-mlx-3Bit

Text Generation • 671B • Updated Sep 23, 2025 • 43 • 1

cs2764/Kimi-K2-Instruct-0905-mlx-3Bit-gs32

Text Generation • 1T • Updated Sep 28, 2025 • 86 • 1

mlx-community/Ring-1T-preview-3bit

Text Generation • Updated Sep 29, 2025 • 8 • 1

mrtoots/unsloth-GLM-4.6-mlx-3Bit

Text Generation • 353B • Updated Oct 1, 2025 • 26

zerofata/MS3.2-PaintedFantasy-Visage-v4-34b-exl3-3bpw

7B • Updated Oct 2, 2025

mlx-community/Apriel-1.5-15b-Thinker-3bit-MLX

Image-Text-to-Text • Updated Oct 3, 2025 • 4