Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,929

Base only

Active filters: 5-bit

zecanard/Qwopus3.6-27B-v2-MLX-5bit-int5-affine

Image-Text-to-Text • 27B • Updated Jun 12 • 12 • 1

exdysa/MiniMax-M2.7-REAP-139B-A10B-MLX-5bit

Text Generation • 139B • Updated May 25 • 31

beezu/Glistening-Gem-31B-v1.0-mlx-5bit-gs32

Text Generation • 31B • Updated May 26 • 21

dawncr0w/Hy-MT2-30B-A3B-oQ5-MLX

Translation • 30B • Updated May 26 • 9

FurAbyss/Equinox-31B-oQ5

31B • Updated May 26 • 11

SipsaLabs/mamba-2.8b-hf-uc-v3-bpw5

Text Generation • Updated May 30

LiquidAI/LFM2.5-8B-A1B-MLX-5bit

Text Generation • 8B • Updated 21 days ago • 522 • 9

SipsaLabs/dinov2-large-uc-v3-bpw5

Image Feature Extraction • Updated May 29

tfjack/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-oQ5-fp16-mtp

36B • Updated Jun 1 • 39

mlx-community/granite-speech-4.1-2b-nar-mlx-5bit

Automatic Speech Recognition • 2B • Updated May 28 • 23

SipsaLabs/mamba2-2.7b-uc-v3-bpw5

Text Generation • Updated May 29

stamsam/LFM2.5-8B-A1B-oQ5

Text Generation • 8B • Updated May 29 • 19

RepublicOfKorokke/LFM2.5-8B-A1B-oQ5-fp16

Text Generation • 8B • Updated May 29 • 22

RepublicOfKorokke/LFM2.5-8B-A1B-oQ5

Text Generation • 8B • Updated May 29 • 20

blockblockblock/Qwen2.5-0.5B-Instruct-exl3-5.0bpw

Text Generation • 0.3B • Updated 23 days ago • 156

mlx-community/LLaDA2.1-mini-5bit

Image-Text-to-Text • 16B • Updated May 30 • 19

Skirosso/Dolphin-X1-Trinity-Nano-5bit-MLX

Text Generation • 6B • Updated May 30 • 118 • 1

FurAbyss/G4-MeroMero-31B-mlx-oQ5

Text Generation • 31B • Updated May 31 • 10

FurAbyss/G4-MeroMero-26B-A4B-mlx-oQ5

Text Generation • 25B • Updated May 31 • 20

blockblockblock/LFM2.5-8B-A1B-uncensored-abliterated-exl3-5.0bpw

Text Generation • 3B • Updated 23 days ago • 159 • 1

usermma/MiniCPM5-1B-mlx-5Bit

Text Generation • 1B • Updated May 31 • 19

mlx-community/Qwen3.5-9B-MTP-5bit

Text Generation • 0.2B • Updated Jun 1 • 197 • 1

blockblockblock/Cydonia-22B-v1.3-exl3-5.0bpw

Text Generation • 7B • Updated 23 days ago • 158

mlx-community/Qwen3.6-27B-MTP-5bit

Text Generation • 0.4B • Updated Jun 1 • 318 • 1

mlx-community/Qwen3.5-4B-MTP-5bit

Text Generation • 0.1B • Updated Jun 1 • 87 • 1

lmstudio-community/Qwen3.6-27B-MLX-5bit

Image-Text-to-Text • 27B • Updated Jun 2 • 494k

wezzel98765/Qwopus3.6-27B-v2-oQ5-fp16-mtp

28B • Updated Jun 7 • 15

wezzel98765/Qwopus3.6-35B-A3B-v1-oQ5-fp16-mtp

36B • Updated Jun 7 • 3

feroxai/gemma-4-26b-a4b-it-hybrid-q5-affine-bf16rest

Image-Text-to-Text • 26B • Updated Jun 3 • 11

mlx-community/gemma-4-12B-it-5bit

Image-Text-to-Text • 12B • Updated Jun 8 • 87 • 1