Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,923

Base only

Active filters: 5-bit

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-5Bit

Text Generation • 8B • Updated Jan 12 • 23

alexgusevski/CapybaraHermes-2.5-Mistral-7B-mlx-5Bit

1B • Updated Jan 12 • 9

alexgusevski/Einstein-v6.1-Llama3-8B-mlx-5Bit

8B • Updated Jan 12 • 12

alexgusevski/saiga_gemma3_12b-mlx-5Bit

12B • Updated Jan 13 • 24

mlx-community/whisper-large-v3-asr-5bit

Automatic Speech Recognition • 0.3B • Updated Jan 13 • 9

mlx-community/whisper-large-v3-turbo-asr-5bit

0.2B • Updated Jan 13 • 26

mlx-community/whisper-large-v2-asr-5bit

Automatic Speech Recognition • 0.3B • Updated Jan 14 • 8

mlx-community/whisper-large-asr-5bit

Automatic Speech Recognition • 0.3B • Updated Jan 14 • 6

mlx-community/whisper-medium-asr-5bit

Automatic Speech Recognition • 0.1B • Updated Jan 14 • 7

mlx-community/MiniMax-M2.1-REAP-40-5bit

Text Generation • 139B • Updated Jan 14 • 26

mlx-community/MiniMax-M2.1-REAP-30-5bit

Text Generation • 162B • Updated Jan 14 • 30

mlx-community/LFM2.5-Audio-1.5B-5bit

Audio-to-Audio • 0.4B • Updated Jan 15 • 11 • 1

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-5Bit

Text Generation • 1B • Updated Jan 15 • 43

alexgusevski/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-mlx-5Bit

Text Generation • 18B • Updated Jan 15 • 49

finding1/LongCat-Flash-Thinking-2601-MLX-5.5bpw

Text Generation • 561B • Updated Jan 16 • 25

mlx-community/whisper-small-asr-5bit

Automatic Speech Recognition • 47.2M • Updated Jan 15 • 15

mlx-community/whisper-tiny-asr-5bit

Automatic Speech Recognition • 7.58M • Updated Jan 15 • 21

mlx-community/whisper-base-asr-5bit

Automatic Speech Recognition • 14.5M • Updated Jan 15 • 15

mlx-community/whisper-medium.en-asr-5bit

Automatic Speech Recognition • 0.1B • Updated Jan 15 • 6

mlx-community/whisper-tiny.en-asr-5bit

Automatic Speech Recognition • 7.58M • Updated Jan 15 • 9

mlx-community/whisper-small.en-asr-5bit

Automatic Speech Recognition • 47.2M • Updated Jan 15 • 7

mlx-community/whisper-base.en-asr-5bit

Automatic Speech Recognition • 14.5M • Updated Jan 15 • 9

LiquidAI/LFM2.5-1.2B-Thinking-MLX-5bit

Text Generation • 0.2B • Updated 20 days ago • 381 • 5

Irfanuruchi/SmolLM-360M-Instruct-MLX-5bit

Text Generation • 67.9M • Updated Jan 17 • 10

mlx-community/PaddleOCR-VL-5bit

Image-Text-to-Text • 0.3B • Updated Jan 19 • 26

mlx-community/GLM-4.7-Flash-5bit

Text Generation • 30B • Updated Jan 25 • 2.97k

NexVeridian/GLM-4.7-Flash-5bit

Text Generation • 30B • Updated Mar 6 • 59 • 1

arcee-ai/Trinity-Nano-Preview-MLX-5bit

Text Generation • 1B • Updated May 28 • 43 • 2

nightmedia/GLM-4.7-Flash-7e-qx54g-hi-mlx

Text Generation • 30B • Updated Jan 20 • 22 • 1

mlx-community/LFM2.5-1.2B-Thinking-5bit

Text Generation • 0.2B • Updated 20 days ago • 191