Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,530

Full-text search

Active filters: 6-bit

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-6bit

27B • Updated 7 days ago • 1.57k • 6

nightmedia/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-qx64-hi-mlx

Text Generation • 27B • Updated 4 days ago • 7.4k • 8

Jackrong/MLX-Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-6bit

Text Generation • 9B • Updated 5 days ago • 1.48k • 4

TheCluster/Qwen3.5-35B-A3B-Heretic-MLX-6bit

Image-Text-to-Text • 35B • Updated 10 days ago • 1.38k • 3

mlx-community/Huihui-Qwen3.5-35B-A3B-abliterated-6bit

Text Generation • 35B • Updated 9 days ago • 1.44k • 3

MaziyarPanahi/phi-4-GGUF

Text Generation • 15B • Updated Jan 8, 2025 • 101k • 7

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 111k • 18

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 106k • 9

nightmedia/Qwen3-53B-A3B-TOTAL-RECALL-MASTER-CODER-v1.4-q6-mlx

Text Generation • 53B • Updated Jul 8, 2025 • 387 • 3

mlx-community/LFM2-8B-A1B-6bit-MLX

Text Generation • 8B • Updated Oct 8, 2025 • 38 • 2

lmstudio-community/LFM2-24B-A2B-MLX-6bit

Text Generation • 24B • Updated 18 days ago • 363k • 2

nightmedia/Qwen3.5-35B-A3B-Text-qx64-hi-mlx

Text Generation • 35B • Updated 6 days ago • 7.83k • 7

inferencerlabs/Qwen3.5-122B-A10B-MLX-6.5bit

Text Generation • 122B • Updated 15 days ago • 1.31k • 1

TheCluster/Qwen3.5-27B-Heretic-MLX-6bit

Image-Text-to-Text • 27B • Updated 10 days ago • 530 • 1

dealignai/Qwen3.5-VL-122B-A10B-6bit-MLX-CRACK

Image-Text-to-Text • 27B • Updated 6 days ago • 223 • 1

mlx-community/Qwen3.5-2B-6bit

Image-Text-to-Text • 0.7B • Updated 11 days ago • 42.9k • 5

CountCandy/Golddiamondgold-Paperbliteration-L33-70b-EXL3-6.0BPW

Text Generation • 27B • Updated 11 days ago • 37 • 1

cs2764/Qwen3.5-397B-A17B-6bit-abliterated-mlx

87B • Updated 10 days ago • 489 • 2

mlx-community/Huihui-Qwen3.5-27B-abliterated-6bit

Text Generation • 27B • Updated 9 days ago • 690 • 1

ailexleon/Slimaki-24B-v1-mlx-6Bit

Text Generation • 24B • Updated 7 days ago • 75 • 1

Jackrong/MLX-Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-6bit

Text Generation • 35B • Updated 5 days ago • 538 • 1

nightmedia/Qwen3.5-35B-A3B-Claude-4.6-Opus-Engineer-9e-qx64-hi-mlx

Text Generation • 35B • Updated 4 days ago • 714 • 1

mlx-community/JOSIE-1.1-4B-Thinking-6bit

Text Generation • 0.9B • Updated 4 days ago • 76 • 1

Wwayu/Jan-code-4b-mlx-6Bit

Text Generation • 0.9B • Updated 4 days ago • 143 • 1

DeathGodlike/crownelius_Crow-9B-Opus-4.6-Distill-Heretic-Qwen3.5_EXL3

Text Generation • Updated about 18 hours ago • 12 • 1

Jackrong/MLX-Qwen3.5-9B-Gemini-3.1-Pro-Reasoning-Distill-6bit

Text Generation • 9B • Updated 2 days ago • 195 • 1

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 1

MaziyarPanahi/phi-2-GGUF

Text Generation • 3B • Updated Jan 26, 2024 • 147 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 175 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 70 • 4