Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,852

Base only

Active filters: mlx

mlx-community/DeepSeek-R1-Distill-Llama-8B-3bit

1B • Updated Feb 26, 2025 • 27

mlx-community/DeepSeek-R1-Distill-Llama-8B-6bit

2B • Updated Feb 26, 2025 • 42

mlx-community/Unsloth-DeepSeek-R1-Distill-Qwen-32B-4bit

Text Generation • 5B • Updated Feb 26, 2025 • 296 • 2

mlx-community/DeepSeek-R1-Distill-Llama-8B-bf16

8B • Updated Feb 26, 2025 • 48 • 3

mlx-community/DeepSeek-R1-Distill-Llama-8B-4bit

1B • Updated Feb 26, 2025 • 1.14k • 10

mrfakename/Wayfarer-12B-Q4-mlx

Text Generation • 2B • Updated Jan 21, 2025 • 15

zhitels/DeepSeek-R1-Distill-Qwen-32B-6bit

Text Generation • 7B • Updated Jan 21, 2025 • 26

mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit

Text Generation • 5B • Updated Feb 26, 2025 • 5.85k • 47

srinivasbilla/llasa-3b-Q4-mlx

0.5B • Updated Jan 21, 2025 • 5 • 2

mlx-community/DeepSeek-R1-Distill-Llama-70B-4bit

Text Generation • 11B • Updated Feb 26, 2025 • 1.48k • 9

mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit

Text Generation • 9B • Updated Feb 26, 2025 • 199 • 5

mlx-community/DeepSeek-R1-Distill-Llama-70B-6bit

Text Generation • 15B • Updated Feb 26, 2025 • 255 • 4

Toto797/test

Text Generation • 3B • Updated Jan 21, 2025 • 8

mlx-community/Mamba-Codestral-7B-v0.1

7B • Updated Jan 21, 2025 • 147 • 2

mlx-community/mamba2-370m

Updated Jan 21, 2025 • 9

mlx-community/mamba2-370m-4bit

Updated Jan 21, 2025 • 10

mlx-community/mamba2-370m-8bit

Updated Jan 21, 2025 • 8

mlx-community/Mamba-Codestral-7B-v0.1-4bit

1B • Updated Jan 21, 2025 • 104 • 1

mlx-community/Mamba-Codestral-7B-v0.1-8bit

2B • Updated Jan 21, 2025 • 116 • 2

mlx-community/Mamba-Codestral-7B-v0.1-6bit

2B • Updated Jan 21, 2025 • 50

mlx-community/DeepSeek-R1-Distill-Llama-8B

Text Generation • 8B • Updated Feb 16, 2025 • 51 • 3

mlx-community/Midnight-Miqu-70B-v1.5-MLX-8Bit

Text Generation • Updated Jan 22, 2025 • 319 • 1

CuckmeisterFuller/DeepSeek-R1-Distill-Llama-8B-Abliterated-Q4-mlx

Text Generation • 1B • Updated Jan 22, 2025 • 47 • 1

umgbhalla/mlx-DeepSeek-R1-Distill-Qwen-1.5B-v0.1-4bit

Text Generation • 0.3B • Updated Jan 22, 2025 • 25

umgbhalla/mlx-DeepSeek-R1-Distill-Qwen-1.5B-v0.1-2bit

Text Generation • 0.2B • Updated Jan 22, 2025 • 10

ubaitur5/DeepSeek-R1-Distill-Qwen-14B-Q3-mlx

Text Generation • Updated Jan 22, 2025 • 8

ubaitur5/Qwen2.5-32B-Instruct-Q3-mlx

Text Generation • Updated Apr 28, 2025 • 21

ubaitur5/Ministral-3b-instruct-Q4-mlx

Text Generation • 0.5B • Updated Jan 22, 2025 • 210 • 3

huchukato/dolphin3.0-llama3.2-3B-4Bit

0.5B • Updated Jan 22, 2025 • 166

mlx-community/dolphin3.0-llama3.2-3B-4Bit

Updated Jan 22, 2025 • 1.66k