Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,819

Base only

Active filters: mlx

mlx-community/Qwen2.5-14B-Instruct-1M-8bit

Text Generation • 4B • Updated Jan 26, 2025 • 401 • 12

mlx-community/Qwen2.5-14B-Instruct-1M-bf16

Text Generation • Updated Jan 26, 2025 • 32 • 2

m-i/Qwen2.5-14B-DeepSeek-R1-1M-Q8-mlx

4B • Updated Jan 27, 2025 • 34 • 2

beezu/Nova-Tempus-70B-v0.2-MLX-8Bit

Text Generation • 20B • Updated Feb 3, 2025 • 6

beezu/Nova-Tempus-70B-v0.2-MLX-4Bit

Text Generation • 11B • Updated Feb 3, 2025 • 2

djphoenix/saiga_nemo_12b-Q6-mlx

3B • Updated Jan 27, 2025 • 38 • 1

djphoenix/Qwen2.5-Coder-14B-Instruct-Q6-mlx

Text Generation • 3B • Updated Jan 27, 2025 • 121 • 1

beezu/Nova-Tempus-70B-v0.2-MLX-6Bit

Text Generation • 15B • Updated Feb 3, 2025 • 1

mlx-community/ABEJA-Qwen2.5-32b-Japanese-v0.1

Text Generation • Updated Jan 27, 2025 • 12

mlx-community/DeepSeek-R1-Distill-Qwen-32B-Japanese

Text Generation • 33B • Updated Jan 27, 2025 • 41 • 1

moot20/DeepSeek-R1-Distill-Llama-8B-MLX-4bit

Text Generation • 1B • Updated Jan 27, 2025 • 17

beezu/Anubis-70B-v1-MLX-8Bit

20B • Updated Jan 27, 2025 • 64

mlx-community/ABEJA-Qwen2.5-32b-Japanese-v0.1-8bit

Text Generation • Updated Jan 27, 2025 • 8

mlx-community/DeepSeek-R1-Distill-Qwen-32B-Japanese-8bit

Text Generation • 9B • Updated Jan 27, 2025 • 123 • 2

beezu/Nova-Tempus-70B-v0.2-MLX-3Bit

Text Generation • 9B • Updated Feb 2, 2025 • 4

WaveCut/Qwen_Qwen2.5-14B-Instruct-1M_MLX-4bit

Text Generation • 2B • Updated Jan 27, 2025 • 82 • 1

beezu/Anubis-70B-v1-MLX-6Bit

15B • Updated Jan 27, 2025 • 27

mlx-community/ABEJA-Qwen2.5-32b-Japanese-v0.1-4bit

Text Generation • Updated Jan 27, 2025 • 8

mlx-community/DeepSeek-R1-Distill-Qwen-32B-Japanese-4bit

Text Generation • 5B • Updated Jan 27, 2025 • 53 • 2

beezu/Anubis-70B-v1-MLX-4Bit

11B • Updated Jan 27, 2025 • 19

JSky74/DeepSeek-R1-Distill-Qwen-14B-mlx

Text Generation • 2B • Updated Jan 27, 2025 • 17

beezu/Anubis-70B-v1-MLX-3Bit

9B • Updated Jan 27, 2025 • 6

isv2lf/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-Q6-mlx

Text Generation • 3B • Updated Jan 28, 2025 • 35

isv2lf/DeepSeek-R1-Distill-Qwen-14B-Uncensored-Q6-mlx

3B • Updated Jan 28, 2025 • 1

isv2lf/magnum-v4-12b-Q8-mlx

Text Generation • 3B • Updated Jan 28, 2025 • 81

wnma3mz/Janus-Pro-1B-LM-4bit

Text Generation • 0.3B • Updated Jan 30, 2025 • 2

wnma3mz/Janus-Pro-7B-LM-4bit

Text Generation • 1B • Updated Jan 30, 2025 • 14 • 2

freeworld1995/deepseek-r1-redistill-qwen-1.5b

Text Generation • 0.3B • Updated Jan 28, 2025 • 7

isv2lf/magnum-v4-12b-Q6-mlx

Text Generation • 3B • Updated Jan 28, 2025 • 51

isv2lf/magnum-v4-22b-Q4-mlx

Text Generation • 3B • Updated Jan 28, 2025 • 74