Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,523

Base only

Active filters: 6-bit

heni86/Kimi-Linear-48B-A3B-Instruct_mlx-hi-6bpw

Text Generation • 49B • Updated Nov 1, 2025 • 57

DeathGodlike/Prototype-X-12b_EXL3

Text Generation • Updated Nov 1, 2025

mlx-community/Ring-mini-linear-2.0-6bit

Text Generation • 16B • Updated Nov 2, 2025 • 23

mlx-community/Ring-flash-linear-2.0-6bit

Text Generation • 104B • Updated Nov 2, 2025 • 11

CallMcMargin/Huihui-Ling-mini-2.0-abliterated-mlx-bf16-affine-qgroup32-q6

Text Generation • 16B • Updated Nov 2, 2025 • 11

KCh3dRi4n/Qwen3-Coder-REAP-25B-A3B-6bit-mlx

Text Generation • 25B • Updated Nov 3, 2025 • 77

CallMcMargin/Huihui-Ring-mini-2.0-abliterated-mlx-bf16-affine-qgroup32-q6

Text Generation • 16B • Updated Nov 3, 2025 • 9

DeathGodlike/Darkest-Grimoire-12B_EXL3

Text Generation • Updated Nov 4, 2025 • 1

DeathGodlike/The-Darkness-12B_EXL3

Text Generation • Updated Nov 4, 2025 • 1

steampunque/Qwen3-VL-8B-Instruct-MP-GGUF

8B • Updated Feb 18 • 102 • 2

steampunque/Qwen3-VL-4B-Instruct-MP-GGUF

4B • Updated Feb 18 • 36 • 2

DeathGodlike/Chrysologus-12B_EXL3

Text Generation • Updated Nov 4, 2025 • 1 • 1

CoruNethron/aquif-3.5-Max-42B-A3B-mlx-6Bit

Text Generation • 42B • Updated Nov 5, 2025 • 15

DeathGodlike/Scarlet-Eclipse-12B_EXL3

Text Generation • Updated Nov 5, 2025 • 1

pdelobelle/fietje-2-chat-mlx-6Bit

Text Generation • 0.6B • Updated Nov 5, 2025 • 28

nightmedia/GLM-Steam-106B-A12B-v1-qx65g-hi-mlx

Text Generation • 107B • Updated Nov 11, 2025 • 13

Marvis-AI/marvis-tts-100m-v0.2-MLX-6bit

Text-to-Audio • 0.1B • Updated Nov 6, 2025 • 81 • 5

mlx-community/Ring-flash-linear-2.0-128k-6bit

Text Generation • 104B • Updated Nov 7, 2025 • 15

Marvis-AI/marvis-tts-250m-v0.2-MLX-6bit

Text-to-Audio • 0.2B • Updated Nov 7, 2025 • 27 • 3

DeathGodlike/Emerald-Wyvern-12B_EXL3

Text Generation • Updated Nov 8, 2025 • 1

AIMLNewbie/Qwen3-Coder-REAP-25B-A3B-mlx-6Bit

Text Generation • 25B • Updated Nov 8, 2025 • 12

DeathGodlike/TinyRP-12B_EXL3

Text Generation • Updated Nov 9, 2025 • 2

zerofata/MS3.2-PaintedFantasy-v3-24B-exl3-6bpw

Text Generation • 9B • Updated Nov 10, 2025 • 8 • 2

DeathGodlike/Forsaken-Void-12B_EXL3

Text Generation • Updated Nov 10, 2025 • 1

steampunque/Qwen2.5-Omni-7B-MP-GGUF

8B • Updated Feb 18 • 44 • 1

CallMcMargin/Qwen2.5-14B-Instruct-1M-abliterated-mlx-bf16-affine-qgroup32-q6

Text Generation • 15B • Updated Nov 10, 2025 • 12

ncls-p/VibeThinker-1.5B-mlx-6Bit

Text Generation • 0.3B • Updated Nov 11, 2025 • 22 • 1

steampunque/Qwen2.5-Coder-7B-Instruct-MP-GGUF

8B • Updated Feb 18 • 13

mlx-community/LightOnOCR-1B-1025-6bit

Image-to-Text • 0.6B • Updated Nov 11, 2025 • 24 • 1

DeathGodlike/WeirdCompound-v1.6-24b_EXL3

Text Generation • Updated Nov 11, 2025 • 3