Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,670

Base only

Active filters: chat

mlx-community/phi-4-8bit

Text Generation • Updated Jan 12, 2025 • 238 • 13

mlx-community/phi-4-3bit

Text Generation • Updated Jan 12, 2025 • 28

mlx-community/phi-4-6bit

Text Generation • Updated Jan 12, 2025 • 52 • 7

TheBlueObserver/QwQ-32B-Preview-MLX-7dd7f

Text Generation • 5B • Updated Dec 16, 2024 • 6

TheBlueObserver/QwQ-32B-Preview-MLX-8777b

Text Generation • 7B • Updated Dec 16, 2024 • 3

TheBlueObserver/QwQ-32B-Preview-MLX-83acc

Text Generation • 8B • Updated Dec 16, 2024 • 2

TheBlueObserver/QwQ-32B-Preview-MLX-2ec71

Text Generation • 7B • Updated Dec 16, 2024 • 5

mradermacher/patricide-12B-Unslop-Mell-v2-i1-GGUF

12B • Updated Dec 17, 2024 • 568 • 6

TheBlueObserver/QwQ-32B-Preview-MLX-c79ba

Text Generation • 7B • Updated Dec 16, 2024 • 3

TheBlueObserver/QwQ-32B-Preview-MLX-393a7

Text Generation • 9B • Updated Dec 16, 2024 • 2

TheBlueObserver/QwQ-32B-Preview-MLX-a720d

Text Generation • 10B • Updated Dec 16, 2024 • 3

TheBlueObserver/QwQ-32B-Preview-MLX-6155e

Text Generation • 9B • Updated Dec 17, 2024 • 4

TheBlueObserver/Qwen2.5-Coder-7B-Instruct-MLX

Text Generation • 8B • Updated Dec 17, 2024 • 12

TheBlueObserver/QwQ-32B-Preview-MLX-e36bb

Text Generation • 9B • Updated Dec 17, 2024 • 6

TheBlueObserver/Qwen2.5-Coder-3B-Instruct-MLX

Text Generation • 3B • Updated Dec 17, 2024 • 15

TheBlueObserver/Qwen2.5-Coder-1.5B-Instruct-MLX

Text Generation • 2B • Updated Dec 17, 2024 • 14

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX

Text Generation • 0.5B • Updated Dec 17, 2024 • 7

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX-0cb1b

Text Generation • 46.4M • Updated Dec 17, 2024 • 5

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX-d5688

Text Generation • 0.2B • Updated Dec 17, 2024 • 13

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX-c6059

Text Generation • 38.7M • Updated Dec 17, 2024 • 13

mlx-community/magnum-v2-72b-4bit

Text Generation • Updated Dec 17, 2024 • 45

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX-9a5c2

Text Generation • 0.2B • Updated Dec 17, 2024 • 27

TheBlueObserver/Qwen2.5-Coder-1.5B-Instruct-MLX-0cb1b

Text Generation • 0.1B • Updated Dec 17, 2024 • 9

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX-104ce

Text Generation • 61.8M • Updated Dec 17, 2024 • 4

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX-4c7d1

Text Generation • 0.2B • Updated Dec 17, 2024 • 4

dnotitia/Llama-DNA-1.0-8B-Instruct-GGUF

Text Generation • 8B • Updated Jan 22, 2025 • 502 • 1

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX-884ea

Text Generation • 54.1M • Updated Dec 17, 2024 • 5

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX-b4ecb

Text Generation • 0.2B • Updated Dec 17, 2024 • 6

nisten/qwen2.5-coder-7b-abliterated-128k-AWQ

Text Generation • 8B • Updated Jan 7, 2025 • 4.67k • 1

TheBlueObserver/Qwen2.5-Coder-0.5B-Instruct-MLX-196c8

Text Generation • 77.3M • Updated Dec 17, 2024 • 7