Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,541

Base only

Active filters: 6-bit

mlx-community/Dans-PersonalityEngine-V1.3.0-24b

Text Generation • 24B • Updated Jun 23, 2025 • 41

mlx-community/Mistral-Small-24B-Instruct-2501-writer

Text Generation • 24B • Updated Jun 23, 2025 • 75 • 1

zerofata/MS3.2-PaintedFantasy-24B_exl3-6bpw

Text Generation • 9B • Updated Jun 26, 2025 • 7

mlx-community/Polaris-7B-Preview-6bit

2B • Updated Jun 24, 2025 • 6

steampunque/Qwen2.5-VL-7B-Instruct-MP-GGUF

8B • Updated Feb 18 • 97

mlx-community/Llama-3.2-8X4B-MOE-V2-Dark-Champion-Instruct-uncensored-abliterated-21B-Q_6-MLX

Text Generation • 21B • Updated Jun 25, 2025 • 613 • 3

narpas/Synthia-S1-27b-6.0bpw-h8-exl2

Image-Text-to-Text • Updated Jun 26, 2025 • 12

mlx-community/Cydonia-24B-v3.1-6bit

Text Generation • 24B • Updated Jun 25, 2025 • 27

async0x42/Qwen3-0.6B-exl3_6.0bpw

0.4B • Updated Jun 25, 2025 • 3

arthurcollet/Mellum-4b-base-mlx-6bit

Text Generation • 0.9B • Updated Jun 26, 2025 • 16

arthurcollet/Qwen3-Reranker-0.6B-mlx-6bit

Text Generation • 0.1B • Updated Jun 26, 2025 • 21

vd1990/gemma-3-12b-it-abliterated-v2-mlx-6Bit

Image-Text-to-Text • 3B • Updated Jun 26, 2025 • 16

narpas/L3.3-Shakudo-70b-6.0bpw-h8-exl2

Updated Jun 29, 2025 • 5 • 1

mlx-community/Gabliterated-Qwen3-0.6B-6bit

Text Generation • 0.1B • Updated Jun 28, 2025 • 8

mlx-community/Qwen3-18B-A3B-Stranger-Thoughts-Q_6

Text Generation • 17B • Updated Jun 28, 2025 • 27 • 1

mlx-community/Anubis-70B-v1.1-6bit

Text Generation • 71B • Updated Jun 28, 2025 • 14

mlx-community/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-6bit

Text Generation • 8B • Updated Jun 30, 2025 • 32 • 1

lmstudio-community/gemma-3n-E4B-it-MLX-6bit

Image-Text-to-Text • Updated Jul 14, 2025 • 37.1k

lmstudio-community/gemma-3n-E2B-it-MLX-6bit

Image-Text-to-Text • Updated Jul 21, 2025 • 390

steampunque/ultravox-v0_5-llama-3_1-8b-MP-GGUF

8B • Updated Feb 18 • 18

zerofata/MS3.2-PaintedFantasy-Visage-33B_exl3_6bpw

Text Generation • 13B • Updated Jul 3, 2025 • 10 • 1

beezu/StrawberryLemonade-70B-v1.2-MLX-6Bit

Text Generation • 71B • Updated Jul 2, 2025 • 6

PF94/Qwen3-8B-6.0bpw-exl2

Text Generation • Updated Jul 2, 2025 • 7

mlx-community/Polaris-4B-Preview-6bit

Text Generation • 0.9B • Updated Jul 3, 2025 • 7

steampunque/gemma-3-4b-it-MP-GGUF

4B • Updated Feb 18 • 6

mlx-community/ERNIE-4.5-21B-A3B-PT-6bit

Text Generation • 22B • Updated Jul 4, 2025 • 20

mlx-community/DiffuCoder-7B-cpGRPO-6bit

Text Generation • 8B • Updated Jul 4, 2025 • 13 • 1

SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_6.0bpw

Text Generation • 2B • Updated Jul 5, 2025 • 6

dengcao/ERNIE-4.5-21B-A3B-PT-6bit

Text Generation • 22B • Updated Jul 6, 2025 • 17

mlx-community/Dolphin-Mistral-24B-Venice-Edition-6bit

Text Generation • 24B • Updated Jul 6, 2025 • 49 • 1