Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,397

Full-text search

Active filters: 5-bit

mlx-community-staging/gemma-3-1b-it-mlx-5Bit

Text Generation • Updated Jun 5, 2025 • 11

MetaphoricalCode/Mistral-Nemo-Gutenberg-Encore-12B-exl3-5bpw-hb6

Text Generation • 4B • Updated Jun 6, 2025 • 4

MetaphoricalCode/Qwen3-Gutenberg-Encore-14B-exl3-5bpw-hb6

Text Generation • 5B • Updated Jun 6, 2025 • 6

MetaphoricalCode/Vitus-Qwen3-14B-exl3-5bpw-hb6

5B • Updated Jun 9, 2025 • 5

Disya/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-exl2-5bpw-h8

Text Generation • Updated Jun 10, 2025 • 1

LibraxisAI/c4ai-command-a-03-2025-q5-mlx

Updated Jun 11, 2025

MetaphoricalCode/Gemma-3-Glitter-27B-exl3-5bpw-hb6

Image-Text-to-Text • 10B • Updated Jun 10, 2025 • 1

matatonic/Magistral-Small-2506-5.0bpw-exl2

Updated Jun 10, 2025

MetaphoricalCode/Yanfei-v2-Qwen3-32B-exl3-5bpw-hb6

Text Generation • 11B • Updated Jun 11, 2025 • 2

LibraxisAI/Qwen3-235B-A22B-MLX-Q5

Text Generation • 235B • Updated Jun 12, 2025 • 13

MetaphoricalCode/Skyfall-36B-v2-exl3-5bpw-hb6

12B • Updated Jun 12, 2025

MetaphoricalCode/Dans-DangerousWinds-V1.1.1-24b-exl3-5bpw-hb6

8B • Updated Jun 13, 2025

MetaphoricalCode/Dans-DangerousWinds-V1.1.0-12b-exl3-5bpw-hb6

4B • Updated Jun 14, 2025

mlx-community/Falcon-H1-0.5B-Instruct-5bit

Text Generation • 98.1M • Updated Sep 26, 2025 • 3

mlx-community/Falcon-H1-1.5B-Instruct-5bit

Text Generation • 0.3B • Updated Sep 26, 2025 • 5

LibraxisAI/QwQ-32B-MLX-Q5

33B • Updated Jun 24, 2025 • 9

LibraxisAI/Qwen3-14b-MLX-Q5

15B • Updated Jun 17, 2025 • 35

MetaphoricalCode/Redemption_Wind_24B-exl3-5bpw-hb6

8B • Updated Jun 20, 2025

SicariusSicariiStuff/Impish_Magic_24B_EXL2_5.0bpw

Text Generation • Updated Jun 21, 2025 • 1

matatonic/Mistral-Small-3.2-24B-Instruct-2506-5.0bpw-exl2

Image-Text-to-Text • Updated Jun 21, 2025 • 5 • 1

Minthy/Qwen3-235B-A22B-5.0bpw-h6-exl3

Text Generation • 74B • Updated Jun 24, 2025 • 3

zerofata/MS3.2-PaintedFantasy-24B_exl3-5bpw

Text Generation • 8B • Updated Jun 26, 2025 • 2

mlx-community/gemma-3n-E4B-it-5bit

Image-Text-to-Text • Updated Jul 12, 2025 • 10

mlx-community/gemma-3n-E2B-it-5bit

Image-Text-to-Text • Updated Jul 12, 2025 • 7

LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5

253B • Updated Jun 30, 2025 • 10

mlx-community/DeepSeek-R1-0528-5bit

Text Generation • 671B • Updated Jul 1, 2025 • 54 • 3

zerofata/MS3.2-PaintedFantasy-Visage-33B_exl3_5bpw

Text Generation • 11B • Updated Jul 3, 2025 • 1

mlx-community/Polaris-4B-Preview-5bit

Text Generation • Updated Jul 3, 2025 • 4

Felladrin/mlx-5bit-Qwen3-4B-Merge-Variant-01

Text Generation • 0.8B • Updated Jul 3, 2025 • 5

mlx-community/Hunyuan-A13B-Instruct-5bit

Text Generation • 80B • Updated Jul 4, 2025 • 13 • 2