Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,529

Base only

Active filters: 6-bit

mlx-community/Devstral-Small-2-24B-Instruct-2512-6bit

Image-Text-to-Text • 6B • Updated Jul 4 • 537 • 5

Gapeleon/GLM-4.6V-Flash-exl3-6.0bpw

Image-Text-to-Text • 5B • Updated Dec 10, 2025 • 5

introvoyz041/Qwen3-Esper3-Reasoning-CODER-Instruct-12B-Brainstorm20x-q6-mlx-mlx-6Bit

Text Generation • 12B • Updated Dec 10, 2025 • 36

mlx-community/Devstral-2-123B-Instruct-2512-6bit

Text Generation • 125B • Updated Dec 10, 2025 • 76

cnfusion/Apriel-1.6-15b-Thinker-mlx-6Bit

Image-Text-to-Text • 14B • Updated Dec 10, 2025 • 14

DeathGodlike/Devstral-Small-2-24B-Instruct-2512_EXL3

Text Generation • Updated Dec 10, 2025 • 14 • 1

DeathGodlike/Red-Synthesis-12B_EXL3

Text Generation • Updated Dec 10, 2025

introvoyz041/QiMing-Holos-Plus-Qwen3-14B-qx6-hi-mlx-mlx-6Bit

Text Generation • 15B • Updated Dec 11, 2025 • 13

introvoyz041/Qwen3-55B-A3B-2507-TOTAL-RECALL-v2-MASTER-CODER-q6-hi-mlx-mlx-6Bit

Text Generation • 53B • Updated Dec 11, 2025 • 30

introvoyz041/Qwen3-42B-A3B-2507-TOTAL-RECALL-v2-Medium-MASTER-CODER-q6-hi-mlx-mlx-4Bit

Text Generation • 42B • Updated Dec 11, 2025 • 21

introvoyz041/Qwen3-MOE-2x8B-TNG-Deckard-Beta-16B-qx64-hi-mlx-mlx-6Bit

Text Generation • 13B • Updated Dec 11, 2025 • 26

alexgusevski/Ministral-3-3B-Instruct-2512-q6-mlx

Text Generation • 0.8B • Updated Dec 11, 2025 • 14

alexgusevski/Ministral-3-3B-Reasoning-2512-q6-mlx

Text Generation • 0.8B • Updated Dec 11, 2025 • 8

alexgusevski/Ministral-3-8B-Instruct-2512-q6-mlx

Text Generation • 8B • Updated Dec 11, 2025 • 13

alexgusevski/Ministral-3-8B-Reasoning-2512-q6-mlx

Text Generation • 8B • Updated Dec 11, 2025 • 16

alexgusevski/Lightning-1.7B-q6-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 9

DeathGodlike/MS3.2-24B-Omega-Diamond_EXL3

Text Generation • Updated Dec 12, 2025

DeathGodlike/Dark-World-24B-v1_EXL3

Text Generation • Updated Dec 12, 2025

lmstudio-community/Olmo-3.1-32B-Think-MLX-6bit

Text Generation • 32B • Updated Dec 12, 2025 • 51

lmstudio-community/Olmo-3.1-32B-Instruct-MLX-6bit

Text Generation • 32B • Updated Dec 12, 2025 • 49

isogen/rnj-1-instruct-exl3-6bpw

4B • Updated Dec 15, 2025 • 6

mlx-community/VibeVoice-Realtime-0.5B-6bit

Text-to-Speech • 0.3B • Updated Dec 15, 2025 • 30 • 1

DeathGodlike/MN-12B-Mag-Mell-R1-Uncensored_EXL3

Text Generation • Updated Dec 13, 2025 • 6

DeathGodlike/Stellar-Odyssey-12b-v0.0_EXL3

Text Generation • Updated Dec 13, 2025 • 1

DeathGodlike/KansenSakura-Conflagration-RP-12b_EXL3

Text Generation • Updated Dec 13, 2025

mlx-community/mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-6Bit

Image-Text-to-Text • 6B • Updated 2 days ago • 341

Ataromoku/ArliAI-Mistral-Small-22B-ArliAI-RPMax-v1.1-exl3-6bpw

8B • Updated Dec 14, 2025 • 7

mlx-community/AutoGLM-Phone-9B-Multilingual-6bit

Image-Text-to-Text • Updated Dec 15, 2025 • 25

Wwayu/Gemma-3-27B-Derestricted-mlx-6Bit

Text Generation • 27B • Updated Dec 15, 2025 • 23

Wwayu/medgemma-27b-text-heretic_med-mlx-6Bit

Text Generation • 27B • Updated Dec 15, 2025 • 71 • 1