Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,927

Base only

Active filters: 5-bit

Outlier-Ai/Outlier-Max-32B-GGUF

Text Generation • 33B • Updated May 5 • 54 • 1

Xartorx/Qwen3.6-35B-A3B-heretic-oQ5

35B • Updated Apr 18 • 21

zecanard/gemma-4-E4B-it-ultra-uncensored-heretic-MLX-5bit-int5-affine

Any-to-Any • 8B • Updated Jun 15 • 95 • 1

zecanard/gemma-4-26B-A4B-it-uncensored-heretic-ara-MLX-5bit-int5-affine

Image-Text-to-Text • 26B • Updated Jun 15 • 112 • 1

zecanard/gemma-4-31b-it-uncensored-heretic-ara-MLX-5bit-int5-affine

Image-Text-to-Text • 31B • Updated Jun 15 • 42 • 1

nabi-chan/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-MLX-5bit

Image-Text-to-Text • 35B • Updated Apr 20 • 33

deepsweet/Qwen3.6-35B-A3B-MLX-oQ5-FP16

Text Generation • 35B • Updated May 10 • 26 • 1

deepsweet/Qwen3.6-35B-A3B-MLX-oQ5

Text Generation • 35B • Updated May 10 • 34 • 3

beezu/G4-MeroMero-26B-A4B-mlx-5bit-gs32

Text Generation • 25B • Updated Apr 20 • 15

splats/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-oQ5e

35B • Updated Apr 29 • 31

sleepy186247/XORTRON.CriminalComputing.2026.27B.Instruct.NEXT-mlx-5Bit

Image-Text-to-Text • 27B • Updated Apr 21 • 25 • 1

hzchng/GLM-4.7-Flash-oQ5

Text Generation • 30B • Updated Apr 21 • 34

aimeri/spoomplesmaxx-gemma4-31B-1200-mlx-5bit

Image-Text-to-Text • 31B • Updated Apr 21 • 9

cpral/Hermes-4-405B-exl3-5bpw

Text Generation • 129B • Updated Apr 22 • 6

mlx-community/Qwen3.6-27B-5bit

Image-Text-to-Text • 27B • Updated Apr 22 • 265 • 2

TheCluster/Qwen3.6-27B-MLX-mixed-5.6bit

Image-Text-to-Text • 27B • Updated Apr 22 • 18 • 1

qurk41/Qwen3.6-27B-mlx-5Bit

Image-Text-to-Text • 27B • Updated Apr 23 • 12

AntimatterAI/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-MLX-5bit

Text Generation • 35B • Updated Apr 23 • 164 • 2

deepsweet/Qwen3.6-27B-MLX-oQ5-FP16

Text Generation • 27B • Updated May 18 • 116 • 2

mlx-community/sapiens2-seg-0.4b-5bit

Image-to-Image • 0.4B • Updated Apr 24 • 12

mlx-community/DeepSeek-V4-Flash-5bit

Text Generation • 284B • Updated Apr 25 • 150

Brooooooklyn/Qwen3.6-27B-UD-Q5_K_XL-mlx

Text Generation • 27B • Updated May 15 • 107 • 2

blockblockblock/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-exl3-5.0bpw

Text Generation • 12B • Updated 23 days ago • 144 • 1

splats/NVIDIA-Nemotron-3-Nano-30B-A3B-oQ5e

32B • Updated Apr 29 • 7

blockblockblock/Qwen3.6-35B-A3B-exl3-5.0bpw

Text Generation • 12B • Updated May 31 • 22

Yannlaff/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Apr 27 • 48

nabi-chan/Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-MLX-5bit

Text Generation • 35B • Updated Apr 27 • 205 • 2

cpral/Hermes-4-405B-exl3-3.5bpw

Text Generation • 91B • Updated Apr 28 • 10

nabi-chan/Huihui-Qwen3.6-27B-abliterated-MLX-5bit

Text Generation • 27B • Updated Apr 28 • 25

mlx-community/Laguna-XS.2-5bit

Text Generation • 33B • Updated Apr 28 • 44