Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,396

Full-text search

Active filters: 5-bit

inferencerlabs/DeepSeek-V3.1-MLX-5.5bit

Text Generation • Updated 12 days ago • 924 • 5

Downtown-Case/OpenBuddy_CoTGen-32B-V1-exl3-4.3bpw-hb8

9B • Updated Aug 22, 2025

Downtown-Case/OpenBuddy_SimpleChat-32B-V1-exl3-4.3bpw-hb8

Text Generation • 9B • Updated Aug 22, 2025 • 1

zerofata/MS3.2-PaintedFantasy-Visage-v3-34B-exl3-5bpw

11B • Updated Aug 30, 2025 • 1

lmstudio-community/Hermes-4-70B-MLX-5bit

71B • Updated Aug 26, 2025 • 54.4k

lmstudio-community/Hermes-4-405B-MLX-5bit

Text Generation • 406B • Updated Aug 26, 2025 • 35

lmstudio-community/Seed-OSS-36B-Instruct-MLX-5bit

Text Generation • 36B • Updated Aug 26, 2025 • 45.2k • 1

mlx-community/Hermes-4-70B-5bit

Text Generation • 71B • Updated Aug 26, 2025 • 4 • 1

MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 27, 2025 • 122k • 1

MaziyarPanahi/Qwen3-30B-A3B-Instruct-2507-GGUF

Text Generation • 31B • Updated Nov 20, 2025 • 65.9k • 4

mlx-community/Hermes-4-14B-5bit

Text Generation • 15B • Updated Sep 3, 2025 • 5

mlx-community/Huihui-GLM-4.5V-abliterated-5bit

Image-Text-to-Text • Updated Sep 4, 2025 • 20

tachyphylaxis/TheDrummer_Anubis-Pro-105B-v1-5.0bpw-h6-exl2

Updated Sep 4, 2025

DBMe/c4ai-command-a-03-2025-exl3-5.0bpw

Text Generation • 38B • Updated Sep 6, 2025 • 2

finding1/LongCat-Flash-Chat-MLX-5.5bpw

Text Generation • 561B • Updated Sep 8, 2025 • 20

NexVeridian/Nova-70B-Llama-3.3-5bit

Text Generation • 71B • Updated Sep 7, 2025 • 18

mlx-community/Qwen3-Next-80B-A3B-Instruct-5bit

Text Generation • Updated Sep 13, 2025 • 37 • 3

mlx-community/Qwen3-Next-80B-A3B-Thinking-5bit

Text Generation • Updated Sep 13, 2025 • 32 • 1

lmstudio-community/Qwen3-Next-80B-A3B-Instruct-MLX-5bit

Text Generation • 80B • Updated Sep 17, 2025 • 50.6k

NexVeridian/Qwen3-Next-80B-A3B-Instruct-5bit

Text Generation • 80B • Updated Dec 25, 2025 • 13

mlx-community/NousResearch_Hermes-4-14B-BF16-abliterated-mlx

Text Generation • Updated Sep 16, 2025 • 37 • 1

lmstudio-community/Qwen3-Next-80B-A3B-Thinking-MLX-5bit

Text Generation • 80B • Updated Sep 16, 2025 • 140

NexVeridian/Qwen3-Next-80B-A3B-Thinking-5bit

Text Generation • 80B • Updated Dec 25, 2025 • 17

lmstudio-community/Magistral-Small-2509-MLX-5bit

Updated Sep 17, 2025 • 47.5k

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-5bit-gs32

Text Generation • 80B • Updated Sep 19, 2025 • 22 • 1

inferencerlabs/DeepSeek-V3.1-Terminus-MLX-5.5bit

Text Generation • Updated 28 days ago • 414 • 1

lmstudio-community/granite-4.0-h-tiny-MLX-5bit

Text Generation • 1B • Updated Sep 29, 2025 • 60

lmstudio-community/granite-4.0-h-small-MLX-5bit

Text Generation • 32B • Updated Sep 29, 2025 • 65

mlx-community/GLM-4.6-5bit

Text Generation • 353B • Updated Sep 30, 2025 • 52 • 3

lmstudio-community/KAT-Dev-MLX-5bit

Text Generation • 33B • Updated Sep 30, 2025 • 29