Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,819

Base only

Active filters: mlx

mlx-community/Evathene-v1.3-MLX-6Bit

Text Generation • 16B • Updated Jan 25, 2025 • 5

rudrankriyam/deepseek-r1-redistill-qwen-1.5b

Text Generation • 0.3B • Updated Jan 25, 2025 • 8

maciejonek/Qwen2.5-7B-Gandalf

Text Generation • 1B • Updated Jan 25, 2025 • 2

hentograf/deepseek-r1-qwen-2.5-32B-ablated-Q4-mlx

Text Generation • 5B • Updated Jan 25, 2025 • 163 • 4

Felprot75/DeepSeek-R1-Distill-Llama-8B-Q6-mlx

Text Generation • 2B • Updated Jan 25, 2025 • 26 • 1

JSky74/deepseek-r1-redistill-qwen-1.5b

Text Generation • 0.3B • Updated Jan 25, 2025 • 14

mlx-community/meditron-7b

Updated Jan 25, 2025 • 56 • 3

mlx-community/Nova-Tempus-70B-v0.1-MLX-8Bit

Text Generation • Updated Jan 26, 2025 • 6

mlx-community/Bio-Medical-Llama-3-2-1B-CoT-012025

Text Generation • Updated Jan 26, 2025 • 102 • 3

mlx-community/Bio-Medical-3B-CoT-012025

Text Generation • Updated Jan 26, 2025 • 14

mlx-community/medllama3-v20

Updated Jan 26, 2025 • 5

mlx-community/MedFound-Llama3-8B-finetuned

1B • Updated Jan 26, 2025 • 9

mlx-community/Nova-Tempus-70B-v0.1-MLX-3Bit

Text Generation • Updated Jan 26, 2025 • 7

danielcfho/qwen2-0.5b-instruct-mlx

Text Generation • 0.5B • Updated Jan 26, 2025 • 1

mlx-community/Nova-Tempus-70B-v0.1-MLX-4Bit

Text Generation • Updated Jan 26, 2025 • 4

danielcfho/qwen2-0.5b-instruct-mlx-q4

Text Generation • 77.3M • Updated Jan 26, 2025 • 1

maciejonek/Llama-3.1-8B-Gandalf

Text Generation • 1B • Updated Jan 26, 2025 • 4

mlx-community/Nova-Tempus-70B-v0.1-MLX-6Bit

Text Generation • Updated Jan 27, 2025 • 2

maciejonek/DeepSeek-R1-Gandalf

Text Generation • 1B • Updated Jan 26, 2025 • 9

milk639/Miel

Text Generation • 1B • Updated Jan 27, 2025 • 9

rudrankriyam/qwen2.5-7b-instruct-1m

Text Generation • 1B • Updated Jan 26, 2025 • 5

mlx-community/Qwen2.5-7B-Instruct-1M-4bit

Text Generation • Updated Jan 26, 2025 • 582 • 11

mlx-community/Qwen2.5-14B-Instruct-1M-4bit

Text Generation • Updated Jan 26, 2025 • 285 • 2

mlx-community/Qwen2.5-7B-Instruct-1M-3bit

Text Generation • Updated Jan 26, 2025 • 18

mlx-community/Qwen2.5-7B-Instruct-1M-6bit

Text Generation • Updated Jan 26, 2025 • 51 • 2

mlx-community/Qwen2.5-7B-Instruct-1M-8bit

Text Generation • Updated Jan 26, 2025 • 89 • 4

mlx-community/Qwen2.5-7B-Instruct-1M-bf16

Text Generation • Updated Jan 26, 2025 • 14

mlx-community/Qwen2.5-14B-Instruct-1M-3bit

Text Generation • Updated Jan 26, 2025 • 11

abalogh/Qwen2.5-14B-Instruct-1M-4bit

Text Generation • 2B • Updated Jan 26, 2025 • 23

mlx-community/Qwen2.5-14B-Instruct-1M-6bit

Text Generation • Updated Jan 26, 2025 • 110 • 2