Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,543

Base only

Active filters: 6-bit

mlx-community/Qwen3-32B-6bit

Text Generation • 7B • Updated Apr 28, 2025 • 54 • 1

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • 33B • Updated Apr 29, 2025 • 296k • 2

mlx-community/Josiefied-Qwen3-0.6B-abliterated-v1-6bit

Text Generation • 0.1B • Updated Apr 29, 2025 • 15

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Apr 29, 2025 • 296k • 5

mlx-community/Josiefied-Qwen3-1.7B-abliterated-v1-6bit

Text Generation • 0.4B • Updated May 1, 2025 • 11

Jellon/QwQ-32B-ArliAI-RpR-v3-exl2-6bpw

Updated Apr 29, 2025 • 8

Dundell391/Qwen3-32B_exl2_6.0bpw

Text Generation • Updated Apr 30, 2025 • 10

Jellon/Qwen3-32B-exl2-6bpw

Text Generation • Updated Apr 30, 2025 • 12 • 1

sleepdeprived3/Reformed-Baptist-1689-Bible-Expert-v2.0-12B_EXL2_6bpw_H8

Text Generation • Updated May 19, 2025 • 11 • 1

mlx-community/Phi-4-reasoning-6bit

Text Generation • 3B • Updated May 1, 2025 • 33 • 1

mlx-community/Phi-4-mini-reasoning-6bit

Text Generation • 0.8B • Updated May 1, 2025 • 37 • 1

prince-canuma/Phi-4-reasoning-Plus-6bit

Text Generation • 3B • Updated May 1, 2025 • 16

mlx-community/Josiefied-Qwen3-4B-abliterated-v1-6bit

Text Generation • 0.9B • Updated May 1, 2025 • 31 • 2

steampunque/Qwen3-8B-MP-GGUF

8B • Updated Apr 22 • 49

mlx-community/Josiefied-Qwen3-8B-abliterated-v1-6bit

Text Generation • 2B • Updated May 2, 2025 • 26 • 1

qurk41/BlackSheep-24B-mlx-6Bit

5B • Updated May 2, 2025 • 16

gtkunit/Qwen3-30B-A3B-6.0bpw-h6-exl2

Text Generation • Updated May 5, 2025 • 15

narpas/Aurora-Borealis-LLaMa-70B-6.0bpw-h8-exl2

Text Generation • Updated May 17, 2025 • 16

isogen/Qwen3-14B-exl3-6bpw

6B • Updated May 12, 2025 • 15

isogen/Phi-4-reasoning-plus-exl3-6bpw

6B • Updated May 5, 2025 • 11

qurk41/mistral-small-3.1-24b-instruct-2503-jackterated-hf-mlx-6Bit

Text Generation • 5B • Updated May 4, 2025 • 20

MuXodious/BlueLight-12B_EXL2_6.0bpw

Text Generation • Updated May 5, 2025 • 12

mxmcc/xLAM-2-32b-fc-r-mlx-6Bit

Text Generation • 7B • Updated May 6, 2025 • 15

MuXodious/EsotericKnowledge-24B_EXL2_6.0bpw

Text Generation • Updated May 7, 2025 • 8

dillonroach/Orpheus-3b-ft-6bpw-exl2

Text-to-Speech • Updated May 7, 2025 • 9

qurk41/Dans-PersonalityEngine-V1.2.0-24b-mlx-6Bit

Text Generation • 5B • Updated May 8, 2025 • 51 • 1

mlx-community/Spark-TTS-0.5B-6bit

Text-to-Speech • 0.1B • Updated May 8, 2025 • 21 • 1

qurk41/Dolphin-Mistral-24B-Venice-Edition-mlx-6Bit

5B • Updated May 9, 2025 • 42 • 1

MetaphoricalCode/Eurydice-24b-v3-6.0bpw-h8-exl2

Text Generation • Updated May 10, 2025 • 11

isogen/Josiefied-Qwen3-8B-abliterated-v1-exl3-6bpw

3B • Updated May 12, 2025 • 12