Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,474

Base only

Active filters: mlx

cnfusion/Llama-3.1-Nemotron-70B-Instruct-HF-Q2-mlx

Text Generation • 7B • Updated Dec 16, 2024 • 17

testmoto/gemma-2-llm2024-dpo-02

Text Generation • 9B • Updated Dec 16, 2024 • 8

TheBlueObserver/QwQ-32B-Preview-MLX-c6059

Text Generation • 3B • Updated Dec 16, 2024 • 9

TheBlueObserver/QwQ-32B-Preview-MLX-9a5c2

Text Generation • 3B • Updated Dec 16, 2024 • 11

TheBlueObserver/QwQ-32B-Preview-MLX-104ce

Text Generation • 4B • Updated Dec 16, 2024 • 7

mlx-community/Llama-3.2-11B-Vision-Instruct-abliterated-4-bit

Image-Text-to-Text • 2B • Updated Dec 16, 2024 • 330 • 1

TheBlueObserver/QwQ-32B-Preview-MLX-4c7d1

Text Generation • 5B • Updated Dec 16, 2024 • 6

mlx-community/Llama-3.2-11B-Vision-Instruct-abliterated-8-bit

Image-Text-to-Text • 3B • Updated Dec 16, 2024 • 150 • 1

testmoto/gemma-2-9b-mix_coding_magpie

Text Generation • 9B • Updated Dec 16, 2024 • 56

TheBlueObserver/QwQ-32B-Preview-MLX-884ea

Text Generation • 4B • Updated Dec 16, 2024 • 8

mlx-community/Llama-3.2-11B-Vision-Instruct-abliterated

Image-Text-to-Text • 11B • Updated Dec 16, 2024 • 820 • 7

TheBlueObserver/QwQ-32B-Preview-MLX-b4ecb

Text Generation • 4B • Updated Dec 16, 2024 • 9

TheBlueObserver/QwQ-32B-Preview-MLX-196c8

Text Generation • 5B • Updated Dec 16, 2024 • 5

TheBlueObserver/QwQ-32B-Preview-MLX-9f4aa

Text Generation • 6B • Updated Dec 16, 2024 • 5

TheBlueObserver/QwQ-32B-Preview-MLX-cea54

Text Generation • 5B • Updated Dec 16, 2024 • 9

mlx-community/phi-4-bf16

Text Generation • 15B • Updated Jan 12, 2025 • 32 • 2

mlx-community/phi-4-4bit

Text Generation • 2B • Updated Jan 12, 2025 • 664 • 22

mlx-community/phi-4-8bit

Text Generation • 4B • Updated Jan 12, 2025 • 141 • 13

mlx-community/phi-4-3bit

Text Generation • 2B • Updated Jan 12, 2025 • 18

mlx-community/phi-4-6bit

Text Generation • 3B • Updated Jan 12, 2025 • 44 • 7

TheBlueObserver/QwQ-32B-Preview-MLX-7dd7f

Text Generation • 5B • Updated Dec 16, 2024 • 6

TheBlueObserver/QwQ-32B-Preview-MLX-8777b

Text Generation • 7B • Updated Dec 16, 2024 • 5

mlx-community/T-pro-it-1.0-Q4-mlx

5B • Updated Dec 16, 2024 • 17 • 1

TheBlueObserver/QwQ-32B-Preview-MLX-83acc

Text Generation • 8B • Updated Dec 16, 2024 • 4

TheBlueObserver/QwQ-32B-Preview-MLX-2ec71

Text Generation • 7B • Updated Dec 16, 2024 • 8

TheBlueObserver/QwQ-32B-Preview-MLX-c79ba

Text Generation • 7B • Updated Dec 16, 2024 • 6

TheBlueObserver/QwQ-32B-Preview-MLX-393a7

Text Generation • 9B • Updated Dec 16, 2024 • 13

TheBlueObserver/QwQ-32B-Preview-MLX-a720d

Text Generation • 10B • Updated Dec 16, 2024 • 5

TheBlueObserver/QwQ-32B-Preview-MLX-6155e

Text Generation • 9B • Updated Dec 17, 2024 • 10

TheBlueObserver/Qwen2.5-Coder-7B-Instruct-MLX

Text Generation • 8B • Updated Dec 17, 2024 • 8