Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,542

Base only

Active filters: 6-bit

mlx-community/MiniCPM4.1-8B-6bit

Text Generation • 8B • Updated Sep 8, 2025 • 7

DeathGodlike/GoldFusionReiV3-12B_EXL3

Text Generation • Updated Sep 8, 2025

dong-99/YanoljaNEXT-Rosetta-4B-mlx-6Bit

Translation • 0.8B • Updated Sep 9, 2025 • 9

DeathGodlike/Moonlight-L3-15B-v2.5-64k_EXL3

Text Generation • Updated Sep 10, 2025 • 3

DeathGodlike/MN-12B-Mag-Mell-R1_EXL3

Text Generation • Updated Sep 10, 2025 • 1 • 1

mlx-community/Ling-mini-2.0-6bit

Text Generation • 16B • Updated Sep 15, 2025 • 40

cactopus/Archaeo-32B-KTO_EXL3_6.0bpw_H8

Text Generation • 13B • Updated Sep 12, 2025 • 7

mlx-community/Qwen3-Next-80B-A3B-Instruct-6bit

Text Generation • 80B • Updated Sep 13, 2025 • 73 • 4

mlx-community/Qwen3-Next-80B-A3B-Thinking-6bit

Text Generation • 80B • Updated Sep 13, 2025 • 24 • 1

nightmedia/Qwen3-Next-80B-A3B-Thinking-qx64-hi-mlx

Text Generation • 80B • Updated Sep 13, 2025 • 21 • 1

mlx-community/glm-4-9b-chat-1m-6bit

Text Generation • 9B • Updated Sep 14, 2025 • 43 • 1

jesusoctavioas/gpt-oss-20b-mlx-6Bit

Text Generation • 21B • Updated Sep 14, 2025 • 21

DeathGodlike/KansenSakura-Radiance-RP-12b_EXL3

Text Generation • Updated Sep 14, 2025 • 3 • 2

nightmedia/Qwen3-Next-80B-A3B-Instruct-qx64-mlx

Text Generation • 80B • Updated Sep 15, 2025 • 31 • 4

beezu/Behemoth-ReduX-123B-v1-MLX-6Bit

Text Generation • 123B • Updated Sep 16, 2025 • 26

mlx-community/Ring-mini-2.0-6bit

Text Generation • 16B • Updated Sep 15, 2025 • 7 • 1

DeathGodlike/Pinecone-Rune-12b_EXL3

Text Generation • Updated Sep 15, 2025 • 1

lmstudio-community/Qwen3-Next-80B-A3B-Instruct-MLX-6bit

Text Generation • 80B • Updated Sep 17, 2025 • 15.5k

abnormalmapstudio/Qwen3-Next-80B-A3B-Thinking-6bit-mlx

Text Generation • Updated Sep 15, 2025 • 1

dphn/Dolphin-Mistral-24B-Venice-Edition-exl2-6bpw

Text Generation • Updated Sep 17, 2025 • 12 • 7

mlx-community/NousResearch_Hermes-4-14B-BF16-abliterated-mlx

Text Generation • 15B • Updated Sep 16, 2025 • 331 • 1

DeathGodlike/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v3_EXL3

Text Generation • Updated Sep 16, 2025

lmstudio-community/Qwen3-Next-80B-A3B-Thinking-MLX-6bit

Text Generation • 80B • Updated Sep 16, 2025 • 116

qurk41/MiMo-VL-7B-RL-2508-mlx-6Bit

Image-Text-to-Text • 8B • Updated Sep 17, 2025 • 52 • 1

lmstudio-community/Magistral-Small-2509-MLX-6bit

Updated Sep 17, 2025 • 21.4k

Wwayu/EtherealAurora-12B-mlx-6Bit

Text Generation • 12B • Updated Sep 18, 2025 • 6

Wwayu/SorcererLM-8x22b-bf16-With-Tokenizer-mlx-6Bit

141B • Updated Sep 18, 2025 • 9

dong-99/CardProjector-27B-v4-mlx-6Bit

Image-Text-to-Text • 27B • Updated Sep 18, 2025 • 11

tensorbanana/vibevoice-7b-exl3-6bit

3B • Updated Sep 19, 2025 • 10

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 31 • 1