Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,539

Base only

Active filters: 6-bit

steampunque/Qwen2.5-VL-32B-Instruct-MP-GGUF

33B • Updated Feb 18 • 49

isogen/Lucy-exl3-6bpw

1.0B • Updated Jul 20, 2025 • 5

SnowFlash383935/gemma-3-4b-it-abliterated-mlx-6Bit

Image-Text-to-Text • 1.0B • Updated Jul 20, 2025 • 11

isogen/OpenReasoning-Nemotron-1.5B-exl3-6bpw

0.8B • Updated Jul 20, 2025 • 9

isogen/OpenReasoning-Nemotron-7B-exl3-6bpw

3B • Updated Jul 21, 2025 • 9

isogen/Jan-nano-exl3-6bpw

2B • Updated Jul 21, 2025 • 5

isetnefret/Synthia-S1-27b-mlx-6Bit

Image-Text-to-Text • 6B • Updated Jul 21, 2025 • 9

lmstudio-community/Qwen3-235B-A22B-Instruct-2507-MLX-6bit

Text Generation • 235B • Updated Jul 21, 2025 • 2.87k

steampunque/GLM-Z1-9B-0414-MP-GGUF

9B • Updated Feb 18 • 56 • 2

mlx-community/Qwen3-235B-A22B-Instruct-2507-6bit

Text Generation • 235B • Updated Jul 22, 2025 • 23

isogen/OpenReasoning-Nemotron-14B-exl3-6bpw

6B • Updated Jul 22, 2025 • 5

lmstudio-community/Qwen3-Coder-480B-A35B-Instruct-MLX-6bit

Text Generation • 480B • Updated Jul 23, 2025 • 5.19k • 5

lmstudio-community/Magistral-Small-2507-MLX-6bit

Text Generation • 24B • Updated Jul 24, 2025 • 35

nightmedia/Mistral-MOE-4X7B-Dark-MultiVerse-Uncensored-Enhanced32-24B-q6-f32-mlx

Text Generation • 24B • Updated Jul 24, 2025 • 50

mlx-community/olmOCR-7B-0725-6bit

Image-Text-to-Text • Updated Jul 25, 2025 • 10

mlx-community/Nanonets-OCR-s-6bit

Image-Text-to-Text • 1B • Updated Jul 25, 2025 • 18

lmstudio-community/Qwen3-235B-A22B-Thinking-2507-MLX-6bit

Text Generation • 235B • Updated Jul 25, 2025 • 224 • 1

nightmedia/Qwen3-Esper3-Reasoning-CODER-Instruct-12B-Brainstorm20x-q6-mlx

Text Generation • 12B • Updated Jul 26, 2025 • 183 • 1

zerofata/MS3.2-PaintedFantasy-v2-24b-exl3-6bpw

Text Generation • 9B • Updated Jul 31, 2025 • 6

lmstudio-community/GLM-4.5-Air-MLX-6bit

Text Generation • 107B • Updated Jul 28, 2025 • 594 • 1

mlx-community/GLM-4.5-Air-6bit

Text Generation • 107B • Updated Jul 28, 2025 • 59 • 3

lmstudio-community/Qwen3-30B-A3B-Instruct-2507-MLX-6bit

Text Generation • 31B • Updated Jul 29, 2025 • 23.5k

mlx-community/Qwen3-30B-A3B-Instruct-2507-6bit

Text Generation • 31B • Updated Jul 29, 2025 • 75

mlx-community/Qwen3-30B-A3B-Instruct-2507-6bit-DWQ

31B • Updated Jul 30, 2025 • 8

bullerwins/Qwen3-30B-A3B-Instruct-2507-exl3-6.0bpw

Text Generation • 12B • Updated Jul 30, 2025 • 5

lmstudio-community/Qwen3-30B-A3B-Thinking-2507-MLX-6bit

Text Generation • 31B • Updated Jul 30, 2025 • 663 • 2

mlx-community/Qwen3-30B-A3B-Instruct-2507-6bit-DWQ-lr3e-7

Text Generation • 31B • Updated Jul 31, 2025 • 15

lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-6bit

Text Generation • 31B • Updated Jul 31, 2025 • 130k • 7

mlx-community/Qwen3-30B-A3B-Instruct-2507-6bit-DWQ-lr5e-8

Text Generation • 31B • Updated Jul 31, 2025 • 9

mlx-community/Qwen3-Coder-30B-A3B-Instruct-6bit

Text Generation • 31B • Updated Jul 31, 2025 • 729 • 1