Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

943

Base only

Active filters: 4bit

Outlier-Ai/Qwen3-32B-MLX-4bit

Text Generation • 33B • Updated May 26 • 26

Outlier-Ai/Qwen3-14B-MLX-4bit

Text Generation • 15B • Updated May 26 • 158 • 1

Outlier-Ai/Qwen3-8B-MLX-4bit

Text Generation • 1B • Updated May 26 • 17

Outlier-Ai/Qwen3-4B-MLX-4bit

Text Generation • 0.6B • Updated May 26 • 13

Outlier-Ai/gpt-oss-20b-MLX-4bit

Text Generation • 21B • Updated May 5 • 46

Outlier-Ai/SmolLM3-3B-MLX-4bit

Text Generation • 0.5B • Updated May 26 • 20

Outlier-Ai/gemma-3-27b-it-MLX-4bit

Text Generation • 27B • Updated May 26 • 54

Outlier-Ai/gemma-3-4b-it-MLX-4bit

Text Generation • 0.6B • Updated May 26 • 21 • 1

uditjain/Nemotron-30B-Math-Instruct-LoRI

Text Generation • Updated Apr 26

uditjain/Nemotron-30B-Code-Instruct-LoRI

Text Generation • Updated Apr 26 • 27

uditjain/Nemotron-30B-Science-Instruct-LoRI

Text Generation • Updated Apr 26 • 6

uditjain/Nemotron-30B-Multi-Domain-DARE-TIES-Merged-LoRI

Text Generation • Updated Apr 26 • 21

stamsam/MedusaGemma-E4B_MLX_4Bit

Text Generation • 1B • Updated Apr 22 • 26

JANGQ-AI/Qwen3.6-27B-JANG_4M

Image-Text-to-Text • 5B • Updated Apr 25 • 120

OsaurusAI/Qwen3.6-27B-JANG_4M

Image-Text-to-Text • 5B • Updated Apr 23 • 63 • 1

lkjiop8/CyberSentinel-9B-bnb-4bit

9B • Updated Apr 23 • 2

soichisumi/harrier-27b-mlx-4bit

Updated Apr 27 • 8

Chunity/Qwen3.6-35B-A3B-AutoRound-AWQ-4bit

Image-Text-to-Text • 7B • Updated Apr 24 • 3.95k • 1

mlx-community/Qwen3.5-27B-OptiQ-4bit

Text Generation • 27B • Updated 21 days ago • 46.6k • 3

SevenOfNine/Aura-4o-Gemma-4-31B-4bit

Image-Text-to-Text • 32B • Updated May 3 • 2 • 1

LibraxisAI/Huihui4-48B-A4B-vmlx-mxfp4

Image-Text-to-Text • 10B • Updated May 12 • 82 • 1

mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 21 days ago • 732 • 3

ovedrive/ERNIE-Image-nf4

Text-to-Image • Updated May 1 • 8

mlx-community/gemma-4-31B-it-OptiQ-4bit

Text Generation • 31B • Updated 15 days ago • 15k • 8

robertobissanti/EngGPT2-16B-A3B-MLX-4bit

Text Generation • 16B • Updated Apr 26 • 17

LibraxisAI/Huihui4-48B-A4B-vmlx-nvfp4

Image-Text-to-Text • 13B • Updated May 11 • 17

dong16/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Apr 27 • 4

TheCluster/Qwen3.5-122B-A10B-Heretic-v2-MLX-mixed-3.8bit

Image-Text-to-Text • 122B • Updated Apr 28 • 244

Joesh1/onca-1.5-9B-INT4

Text Generation • 9B • Updated 25 days ago • 20

TheCluster/Qwen3.6-35B-A3B-Heretic-MLX-mixed-3.9bit

Image-Text-to-Text • 35B • Updated Apr 29 • 71