Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16,237

Base only

Active filters: mlx

pcuenq/TinyLlama-1.1B-Chat-v1.0-Q8-mlx

0.3B • Updated Oct 17, 2024 • 12

mlx-community/Llama-3.2-11B-Vision-Instruct-4bit

Image-Text-to-Text • 2B • Updated Oct 18, 2024 • 1.07k • 7

mlx-community/Llama-3.2-11B-Vision-Instruct-8bit

Image-Text-to-Text • 3B • Updated Oct 18, 2024 • 1.62k • 9

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q4-mlx

0.2B • Updated Oct 18, 2024 • 11 • 1

morgul/UNA-TheBeagle-7b-v1-Q8-mlx

Text Generation • 2B • Updated Oct 18, 2024 • 5

mlx-community/llama-30b-supercot

Updated Oct 18, 2024 • 10

GGorman/DeepSeek-Coder-V2-Instruct-Q4-mlx

37B • Updated Oct 19, 2024 • 227 • 1

mlx-community/airoboros-33b-gpt4-1.4

Updated Oct 19, 2024 • 100 • 2

VincentGOURBIN/Llama-Guard-3-8B

Text Generation • 8B • Updated Oct 19, 2024 • 624 •

GGorman/WizardCoder-33B-V1.1-Q8-mlx

Text Generation • 9B • Updated Oct 19, 2024 • 32

GGorman/Qwen2.5-72B-Instruct-Q8-mlx

Text Generation • 20B • Updated Jul 31, 2025 • 123

GGorman/Qwen2.5-Coder-7B-Instruct-Q8-mlx

Text Generation • 2B • Updated Oct 19, 2024 • 54

mlx-community/CalmeRys-78B-Orpo-v0.1-4bit

Text Generation • Updated Oct 20, 2024 • 9

katopz/kbtg-kpoint-v1-fused

Text Generation • 3B • Updated Oct 20, 2024 • 7

mlx-community/Fimbulvetr-11B-v2-8bit

3B • Updated Oct 20, 2024 • 61

mlx-community/Fimbulvetr-11B-v2

11B • Updated Oct 20, 2024 • 35

win28703/Llama-3.1-Nemotron-70B-Instruct-HF-Q8-mlx

Text Generation • 20B • Updated Oct 21, 2024 • 33

mlx-community/dolphin-2.9.4-llama3.1-8b

Updated Oct 21, 2024 • 28 • 1

mlx-community/dolphin-2.9.4-llama3.1-8b-4bit

Updated Oct 21, 2024 • 41

mlx-community/dolphin-2.9.4-llama3.1-8b-8bit

Updated Oct 21, 2024 • 173 • 3

Felprot75/dolphin-2.9.4-llama3.1-8b-Q8-mlx

2B • Updated Oct 21, 2024 • 14

mlx-community/Rombos-LLM-V2.6-Qwen-14b-4bit

Text Generation • Updated Oct 21, 2024 • 26

mlx-community/Qwen2.5-7B-Instruct-Uncensored-4bit

Text Generation • Updated Oct 21, 2024 • 719 • 4

mlx-community/xLAM-7b-fc-r

Text Generation • Updated Oct 22, 2024 • 31 • 1

mlx-community/Tanuki-8B-dpo-v1.0-4bit

Text Generation • Updated Oct 21, 2024 • 47

mlx-community/gemma-2-27b-bf16-4bit

Text Generation • Updated Oct 22, 2024 • 28

mlx-community/gemma-2-27b-it-bf16-4bit

Text Generation • Updated Nov 6, 2024 • 28

mlx-community/gemma-2-27b-bf16-8bit

Text Generation • Updated Oct 22, 2024 • 13

mlx-community/gemma-2-27b-it-bf16-8bit

Text Generation • Updated Nov 6, 2024 • 10

mlx-community/rinna-llama-3-youko-8b-instruct-4bit

Updated Oct 22, 2024 • 11