Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,540

Base only

Active filters: 6-bit

mlx-community/Dolphin-Mistral-24B-Venice-Edition-6bit

Text Generation • 24B • Updated Jul 6, 2025 • 49 • 1

mlx-community/gemma-3n-E2B-it-6bit

Image-Text-to-Text • Updated Jul 12, 2025 • 22

mlx-community/gemma-3n-E2B-6bit

Image-Text-to-Text • Updated Jul 12, 2025 • 18

mlx-community/gemma-3n-E4B-it-6bit

Image-Text-to-Text • Updated Jul 12, 2025 • 17

mlx-community/gemma-3n-E4B-6bit

Image-Text-to-Text • Updated Jul 12, 2025 • 16

nightmedia/Qwen3-53B-A3B-TOTAL-RECALL-MASTER-CODER-v1.4-q6-mlx

Text Generation • 53B • Updated Jul 8, 2025 • 101 • 3

fedora-copr/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Jul 9, 2025 • 7

mlx-community/SmolLM3-3B-6bit

Text Generation • 0.7B • Updated Jul 8, 2025 • 17

mlx-community/SmolLM3-3B-Base-6bit

Text Generation • 0.7B • Updated Jul 8, 2025 • 5

arthurcollet/OpenCodeReasoning-Nemotron-1.1-14B-mlx-6bit

Text Generation • 15B • Updated Jul 9, 2025 • 6

steampunque/Llama-3.1-8B-Instruct-MP-GGUF

8B • Updated Feb 18 • 18

lmstudio-community/SmolLM3-3B-MLX-6bit

Text Generation • 0.7B • Updated Jul 9, 2025 • 88 • 1

lmstudio-community/Devstral-Small-2507-MLX-6bit

Text Generation • 24B • Updated Jul 10, 2025 • 15.4k

mlx-community/medgemma-27b-it-6bit

Image-Text-to-Text • Updated Jul 10, 2025 • 57

lmstudio-community/ERNIE-4.5-21B-A3B-MLX-6bit

Text Generation • 22B • Updated Jul 10, 2025 • 23.3k • 1

mlx-community/Devstral-Small-2507-6bit

Text Generation • 24B • Updated Jul 11, 2025 • 25 • 1

mlx-community/Devstral-Small-2507-8bit

Text Generation • 24B • Updated Jul 11, 2025 • 69 • 1

mlx-community/LFM2-350M-6bit

Text Generation • 77.6M • Updated Jul 11, 2025 • 7 • 1

mlx-community/LFM2-700M-6bit

Text Generation • 0.2B • Updated Jul 11, 2025 • 11 • 1

mlx-community/LFM2-1.2B-6bit

Text Generation • 0.3B • Updated Jul 12, 2025 • 17 • 3

cnfusion/reka-flash-3.1-mlx-6Bit

5B • Updated Jul 12, 2025 • 6

mlx-community/reka-flash-3.1-6bit

5B • Updated Jul 12, 2025 • 7

mlx-community/Kimi-Dev-72B-6bit

Text Generation • 73B • Updated Jul 12, 2025 • 197 • 1

PantiPenti/DeepSeek-R1-Distill-Qwen-32B-Uncensored-mlx-6Bit

7B • Updated Jul 14, 2025

steampunque/Deepseek-R1-Distill-Llama-8B-MP-GGUF

8B • Updated Feb 18 • 1

nightmedia/Qwen3-4B-BiasExpert-dwq6-mlx

Text Generation • 1B • Updated Jul 15, 2025 • 9 • 2

lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-MLX-6bit

Image-Text-to-Text • Updated Jul 15, 2025 • 22.6k

woung717/EVEE-Korean-Instruct-7B-v2.0-Preview-MLX-6bits

Text Generation • 8B • Updated Jul 16, 2025 • 12

beezu/StrawberryLemonade-70B-v1.1-MLX-6Bit

Text Generation • 71B • Updated Jul 18, 2025 • 7

mlx-community/Marx-3B-V2-6bit

Text Generation • 0.7B • Updated Jul 18, 2025 • 7