Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,852

Base only

Active filters: mlx

moot20/Qwen2.5-Coder-14B-Instruct-MLX-4bits

Text Generation • 2B • Updated Jan 31, 2025 • 45

jay16/deepseek-r1-quantized

Text Generation • 0.3B • Updated Feb 1, 2025 • 8

tonystark96/deepseek-r1-redistill-qwen-1.5b

Text Generation • 0.3B • Updated Feb 1, 2025 • 7

moot20/Qwen2.5-Coder-14B-Instruct-MLX-8bits

Text Generation • 4B • Updated Feb 1, 2025 • 32

bitznbrewz/Hermes-3-Llama-3.2-3B.Q4_K_M-MLX

Text Generation • 0.5B • Updated Feb 1, 2025 • 82 • 1

moot20/Qwen2.5-Coder-7B-Instruct-MLX-4bits

Text Generation • 1B • Updated Feb 1, 2025 • 17

moot20/Qwen2.5-Coder-7B-Instruct-MLX-6bits

Text Generation • 2B • Updated Feb 1, 2025 • 49

moot20/Qwen2.5-Coder-7B-Instruct-MLX-8bits

Text Generation • 2B • Updated Feb 1, 2025 • 7

moot20/Qwen2.5-Coder-3B-Instruct-MLX-4bits

Text Generation • 0.5B • Updated Feb 1, 2025 • 15

moot20/Qwen2.5-Coder-3B-Instruct-MLX-6bits

Text Generation • 0.7B • Updated Feb 1, 2025 • 4

moot20/Qwen2.5-Coder-3B-Instruct-MLX-8bits

Text Generation • 0.9B • Updated Feb 1, 2025 • 9

moot20/Qwen2.5-Coder-0.5B-Instruct-MLX-4bits

Text Generation • 77.3M • Updated Feb 1, 2025 • 9

moot20/Qwen2.5-Coder-0.5B-Instruct-MLX-6bits

Text Generation • 0.1B • Updated Feb 1, 2025 • 12

moot20/Qwen2.5-Coder-0.5B-Instruct-MLX-8bits

Text Generation • 0.1B • Updated Feb 1, 2025 • 7

moot20/Qwen2.5-VL-7B-Instruct-MLX-4bits

Image-Text-to-Text • 1B • Updated Feb 19, 2025 • 97

moot20/Qwen2.5-VL-7B-Instruct-MLX-6bits

Image-Text-to-Text • 2B • Updated Feb 19, 2025 • 22

moot20/Qwen2.5-VL-7B-Instruct-MLX-8bits

Image-Text-to-Text • 2B • Updated Feb 19, 2025 • 73

moot20/Qwen2.5-VL-3B-Instruct-MLX-4bits

Image-Text-to-Text • 0.7B • Updated Feb 19, 2025 • 26

moot20/Qwen2.5-VL-3B-Instruct-MLX-6bits

Image-Text-to-Text • 0.9B • Updated Feb 19, 2025 • 18

moot20/Qwen2.5-VL-3B-Instruct-MLX-8bits

Image-Text-to-Text • 1B • Updated Feb 19, 2025 • 20 • 1

moot20/Llama-3.1-Tulu-3-8B-MLX-4bits

Text Generation • 1B • Updated Feb 1, 2025 • 1

moot20/Llama-3.1-Tulu-3-8B-MLX-6bits

Text Generation • 2B • Updated Feb 1, 2025 • 1

moot20/Llama-3.1-Tulu-3-8B-MLX-8bits

Text Generation • 2B • Updated Feb 1, 2025 • 1

moot20/phi-4-MLX-6bits

Text Generation • 3B • Updated Feb 1, 2025 • 1

moot20/phi-4-MLX-8bits

Text Generation • 4B • Updated Feb 1, 2025 • 1

jay16/redistill-qwen-1.5b

Text Generation • 0.3B • Updated Feb 2, 2025 • 2 • 1

moot20/Mistral-Small-24B-Instruct-2501-MLX-6bits

Text Generation • 5B • Updated Feb 3, 2025 • 10

moot20/Mistral-Small-24B-Instruct-2501-MLX-8bits

Text Generation • 7B • Updated Feb 3, 2025 • 2

mukulp/Qwen2.5-VL-72B-Instruct-bf16

Image-Text-to-Text • 73B • Updated Feb 2, 2025 • 74

moot20/Mistral-Small-24B-Base-2501-MLX-6bits

Text Generation • 5B • Updated Feb 2, 2025 • 7