Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,692

Base only

Active filters: mlx

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q4-mlx

0.2B • Updated Oct 18, 2024 • 10 • 1

morgul/UNA-TheBeagle-7b-v1-Q8-mlx

Text Generation • 2B • Updated Oct 18, 2024 • 10

mlx-community/llama-30b-supercot

9B • Updated Oct 18, 2024 • 8

GGorman/DeepSeek-Coder-V2-Instruct-Q4-mlx

37B • Updated Oct 19, 2024 • 107 • 1

mlx-community/airoboros-33b-gpt4-1.4

9B • Updated Oct 19, 2024 • 62 • 2

VincentGOURBIN/Llama-Guard-3-8B

Text Generation • 8B • Updated Oct 19, 2024 • 87 •

GGorman/WizardCoder-33B-V1.1-Q8-mlx

Text Generation • 9B • Updated Oct 19, 2024 • 21

GGorman/Qwen2.5-72B-Instruct-Q8-mlx

Text Generation • 20B • Updated Jul 31, 2025 • 113

GGorman/Qwen2.5-Coder-7B-Instruct-Q8-mlx

Text Generation • 2B • Updated Oct 19, 2024 • 34

mlx-community/CalmeRys-78B-Orpo-v0.1-4bit

Text Generation • 12B • Updated Oct 20, 2024 • 15

katopz/kbtg-kpoint-v1-fused

Text Generation • 3B • Updated Oct 20, 2024 • 23

mlx-community/Fimbulvetr-11B-v2-8bit

3B • Updated Oct 20, 2024 • 78

mlx-community/Fimbulvetr-11B-v2

11B • Updated Oct 20, 2024 • 31

win28703/Llama-3.1-Nemotron-70B-Instruct-HF-Q8-mlx

Text Generation • 20B • Updated Oct 21, 2024 • 26

mlx-community/dolphin-2.9.4-llama3.1-8b

8B • Updated Oct 21, 2024 • 31 • 1

mlx-community/dolphin-2.9.4-llama3.1-8b-4bit

1B • Updated Oct 21, 2024 • 59

mlx-community/dolphin-2.9.4-llama3.1-8b-8bit

2B • Updated Oct 21, 2024 • 129 • 3

Felprot75/dolphin-2.9.4-llama3.1-8b-Q8-mlx

2B • Updated Oct 21, 2024 • 17

mlx-community/Rombos-LLM-V2.6-Qwen-14b-4bit

Text Generation • 2B • Updated Oct 21, 2024 • 36

mlx-community/Qwen2.5-7B-Instruct-Uncensored-4bit

Text Generation • 1B • Updated Oct 21, 2024 • 957 • 7

mlx-community/xLAM-7b-fc-r

Text Generation • 7B • Updated Oct 22, 2024 • 19 • 1

mlx-community/Tanuki-8B-dpo-v1.0-4bit

Text Generation • 1B • Updated Oct 21, 2024 • 10

mlx-community/gemma-2-27b-bf16-4bit

Text Generation • 4B • Updated Oct 22, 2024 • 10

mlx-community/gemma-2-27b-it-bf16-4bit

Text Generation • 4B • Updated Nov 6, 2024 • 16

mlx-community/gemma-2-27b-bf16-8bit

Text Generation • 8B • Updated Oct 22, 2024 • 10

mlx-community/gemma-2-27b-it-bf16-8bit

Text Generation • 8B • Updated Nov 6, 2024 • 14

mlx-community/rinna-llama-3-youko-8b-instruct-4bit

1B • Updated Oct 22, 2024 • 15

argmaxinc/mlx-stable-diffusion-3.5-large

Text-to-Image • Updated Oct 28, 2024 • 1.12k • 17

mlx-community/rinna-llama-3-youko-8b-instruct-8bit

2B • Updated Oct 23, 2024 • 6

lucasnewman/descript-audio-codec-24khz

74.7M • Updated Oct 28, 2024