Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,535

Base only

Active filters: 6-bit

federicoramos77/Phi-3-mini-4k-instruct-mlx-6Bit

Text Generation • 0.8B • Updated Aug 1, 2025 • 5

mlx-community/Qwen3-Coder-30B-A3B-Instruct-6bit-DWQ-lr3e-7

Text Generation • 31B • Updated Aug 2, 2025 • 169

mlx-community/Qwen3-Coder-30B-A3B-Instruct-6bit-DWQ-lr9e-8

Text Generation • 31B • Updated Aug 2, 2025 • 85

mlx-community/Qwen3-30B-A3B-Instruct-2507-6bit-DWQ-lr8e-7

Text Generation • 31B • Updated Aug 2, 2025 • 13

mlx-community/XBai-o4-6bit

Text Generation • 33B • Updated Aug 2, 2025 • 9

CycloneDX/cdx1-pro-mlx-6bit

Text Generation • 31B • Updated Aug 10, 2025 • 13

mlx-community/Qwen3-30B-A3B-Instruct-2507-6bit-DWQ-lr1e-8

Text Generation • 31B • Updated Aug 2, 2025 • 18 • 1

mlx-community/Qwen3-30B-A3B-Instruct-2507-6bit-DWQ-lr5e-9

Text Generation • 31B • Updated Aug 2, 2025 • 14

zerofata/MS3.2-PaintedFantasy-Visage-v2-33B-exl3-6bpw

Text Generation • 13B • Updated Aug 3, 2025 • 5

inferencerlabs/openai-gpt-oss-120b-MLX-Q6.5

Text Generation • 117B • Updated Dec 19, 2025 • 233 • 1

isogen/II-Search-CIR-4B-exl3-6bpw

2B • Updated Aug 6, 2025 • 5

mlx-community/VisualQuality-R1-7B-6bit

Reinforcement Learning • Updated Aug 6, 2025 • 16

lmstudio-community/Qwen3-4B-Instruct-2507-MLX-6bit

Text Generation • 0.9B • Updated Aug 6, 2025 • 48.4k

lmstudio-community/Qwen3-4B-Thinking-2507-MLX-6bit

Text Generation • 0.9B • Updated Aug 6, 2025 • 54.3k • 2

mlx-community/Qwen3-4B-Thinking-2507-6bit

Text Generation • 0.9B • Updated Aug 6, 2025 • 12

mlx-community/Qwen3-4B-Instruct-2507-6bit

Text Generation • 0.9B • Updated Aug 6, 2025 • 88 • 1

cs2764/Huihui-Qwen3-30B-A3B-Thinking-2507-abliterated-mlx-6Bit-gs32

Text Generation • 31B • Updated Aug 6, 2025 • 16

cs2764/Huihui-Qwen3-30B-A3B-Instruct-2507-abliterated-mlx-6Bit-gs32

Text Generation • 31B • Updated Aug 6, 2025 • 43

isetnefret/Lewd-Sydney-20B-mlx-6Bit

4B • Updated Aug 7, 2025 • 22

isetnefret/Rose-20B-mlx-6Bit

Text Generation • 4B • Updated Aug 7, 2025 • 6

CycloneDX/cdx1-mini-mlx-6bit

Text Generation • 0.9B • Updated Aug 10, 2025 • 8

mlx-community/gemma-3-270m-6bit

Text Generation • 95.4M • Updated Aug 9, 2025 • 39

mlx-community/gemma-3-270m-it-6bit

Text Generation • 95.4M • Updated Aug 9, 2025 • 18

mlx-community/gemma-3-270m-qat-6bit

Text Generation • 95.4M • Updated Aug 9, 2025 • 5

mlx-community/gemma-3-270m-it-qat-6bit

Text Generation • 95.4M • Updated Aug 9, 2025 • 7

beezu/Irixxed-Magcap-12B-Slerp-MLX-6Bit

Text Generation • 12B • Updated Aug 10, 2025 • 6

SicariusSicariiStuff/Impish_Nemo_12B_EXL3_6.0bpw

Text Generation • 5B • Updated Aug 10, 2025 • 7

Minthy/GLM-4.5-Air-exl3-6bpw

Text Generation • 41B • Updated Aug 10, 2025 • 11 • 1

ton-An/DeepSeek-Coder-V2-Lite-Base-mlx-6Bit

3B • Updated Aug 10, 2025 • 127

beezu/Violet_Magcap-12B-MLX-6Bit

Text Generation • 12B • Updated Aug 11, 2025 • 6