Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,540

Base only

Active filters: 6-bit

mlx-community/Falcon3-10B-Instruct-1.58bit-6bit

Text Generation • 3B • Updated Jun 10, 2025 • 11

mlx-community/Falcon-E-1B-Instruct-6bit

Text Generation • 0.4B • Updated Jun 10, 2025 • 8

mlx-community/Falcon-E-3B-Instruct-6bit

Text Generation • 0.8B • Updated Jun 10, 2025 • 6

MetaphoricalCode/Gemma-3-Glitter-27B-exl3-6bpw-hb6

Image-Text-to-Text • 12B • Updated Jun 10, 2025 • 5

beezu/StrawberryLemonade-L3-70B-v1-MLX-6Bit

Text Generation • 71B • Updated Jun 11, 2025 • 15

Qwen/Qwen3-32B-MLX-6bit

Text Generation • 7B • Updated Jul 7, 2025 • 265 • 4

Qwen/Qwen3-30B-A3B-MLX-6bit

Text Generation • 6B • Updated Jul 7, 2025 • 231 • 5

Qwen/Qwen3-235B-A22B-MLX-6bit

Text Generation • 48B • Updated Jul 7, 2025 • 183 • 4

MetaphoricalCode/Yanfei-v2-Qwen3-32B-exl3-6bpw-hb6

Text Generation • 13B • Updated Jun 11, 2025 • 8

janboe91/Magistral-Small-2506-bf16-mlx-6Bit

Text Generation • 5B • Updated Jun 12, 2025 • 11

Jellon/Qwen3-30B-A3B-exl2-6bpw

Text Generation • Updated Jun 13, 2025 • 9

MetaphoricalCode/Skyfall-36B-v2-exl3-6bpw-hb6

14B • Updated Jun 12, 2025 • 4

MetaphoricalCode/Dans-DangerousWinds-V1.1.1-24b-exl3-6bpw-hb6

9B • Updated Jun 13, 2025 • 8

MetaphoricalCode/Dans-DangerousWinds-V1.1.0-12b-exl3-6bpw-hb6

5B • Updated Jun 14, 2025 • 4

Jellon/QwQ-32B-ArliAI-RpR-v4-exl2-6bpw

Text Generation • Updated Jun 14, 2025 • 5

mlx-community/Falcon-H1-0.5B-Instruct-6bit

Text Generation • 0.1B • Updated Sep 26, 2025 • 11

mlx-community/Falcon-H1-1.5B-Instruct-6bit

Text Generation • 0.3B • Updated Sep 26, 2025 • 10

ALYTV/Qwen2.5-Coder-7B-mlx-6Bit

Text Generation • 2B • Updated Jun 15, 2025 • 14

ALYTV/DeepSeek-R1-Distill-Qwen-7B-mlx-6Bit

Text Generation • 2B • Updated Jun 16, 2025 • 15

ALYTV/zeta-mlx-6Bit

2B • Updated Jun 16, 2025 • 7

soundTeam/Q3-8B-Kintsugi_mlx-6bpw

Text Generation • 8B • Updated Jun 16, 2025 • 7

PF94/Qwen2.5-VL-32B-Instruct-6.0bpw-exl2

Image-Text-to-Text • Updated Jul 2, 2025 • 5

mlx-community/Josiefied-Qwen3-30B-A3B-abliterated-v2-6bit

Text Generation • 31B • Updated Jun 19, 2025 • 22

D8A/XortronCriminalComputingConfig-mlx-6Bit

Text Generation • 5B • Updated Jun 19, 2025 • 10

mlx-community/Skywork-SWE-32B-6bit

Text Generation • 33B • Updated Jun 19, 2025 • 14

MetaphoricalCode/Redemption_Wind_24B-exl3-6bpw-hb6

9B • Updated Jun 20, 2025 • 4

D8A/Impish_Magic_24B-mlx-6Bit

5B • Updated Jun 20, 2025 • 12

Jellon/Mistral-Small-3.2-24B-Instruct-2506-exl3-6bpw

Image-Text-to-Text • 10B • Updated Jun 21, 2025 • 16

SicariusSicariiStuff/Impish_Magic_24B_EXL2_6.0bpw

Text Generation • Updated Jun 21, 2025 • 9

synergy-float/gemma-3-12b-it-abliterated-v2-mlx-6Bit

Image-Text-to-Text • 3B • Updated Jun 22, 2025 • 17