Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,180

Base only

Active filters: mlx

decisionslab/Dlab-852-4bit

Text Generation • 1B • Updated Feb 28, 2025

mlx-community/Josiefied-Qwen2.5-Coder-7B-Instruct-abliterated-v1-4bit

Text Generation • 1B • Updated Feb 16, 2025 • 109 • 1

CuckmeisterFuller/Dolphin3.0-Mistral-24B-Q2-mlx

Text Generation • 2B • Updated Feb 8, 2025 • 26

mlx-community/Hunyuan-7B-Instruct-fp16

Text Generation • 8B • Updated Feb 8, 2025 • 10

mlx-community/Hunyuan-7B-Instruct-8bit

Text Generation • 2B • Updated Feb 8, 2025 • 12

mlx-community/Hunyuan-7B-Instruct-6bit

Text Generation • 2B • Updated Feb 8, 2025 • 8

CuckmeisterFuller/Dolphin3.0-Mistral-24B-Q3-mlx

Text Generation • 3B • Updated Feb 8, 2025 • 20

mlx-community/Hunyuan-7B-Instruct-4bit

Text Generation • 1B • Updated Feb 8, 2025 • 29

mlx-community/Hunyuan-7B-Instruct-3bit

Text Generation • 0.9B • Updated Feb 8, 2025 • 10

matt4011/Qwen2.5-7B-Instruct_cancel_refund_unclear_v1

Text Generation • 8B • Updated Feb 8, 2025 • 9

mlx-community/granite-3.2-8b-instruct-preview-4bit

Text Generation • 1B • Updated Feb 8, 2025 • 16 • 1

mlx-community/granite-3.2-8b-instruct-preview-8bit

Text Generation • 2B • Updated Feb 8, 2025 • 7

AlfRjw/DeepSeek-R1-ReDistill-Llama3-8B-v1.1-Q4-mlx

Text Generation • 1B • Updated Feb 8, 2025 • 13

ainugget/Monstral-123B-v2-Q2-MLX

Text Generation • 11B • Updated Feb 9, 2025 • 16

Severian/Glyphstral-24b-v1

7B • Updated Feb 11, 2025 • 25 • 13

AlfRjw/DeepSeek-R1-ReDistill-Llama3-8B-v1.1-Q3-mlx

Text Generation • 1B • Updated Feb 9, 2025 • 9

ljnlonoljpiljm/florence-2-base-phrases-cb-r2-mlx

Image-Text-to-Text • 0.3B • Updated Feb 14, 2025 • 4

mlx-community/DeepSeek-R1-2bit

Text Generation • 84B • Updated Mar 6, 2025 • 143 • 9

mradermacher/Code-Summary-Llama-3.2-3B-Instruct-GGUF

3B • Updated Feb 10, 2025 • 64

ShotMisser64/Glyphstral-24b-v1-Q6_K-GGUF

24B • Updated Feb 10, 2025 • 4

player1537/Mistral-7B-v0.3-4bit

1B • Updated Feb 10, 2025 • 10

GreenBitAI/DeepSeek-R1-Distill-Qwen-1.5B-layer-mix-bpw-4.0-mlx

0.7B • Updated Feb 11, 2025 • 11

asjoberg/Qwen2-0.5B-Instruct-predli-finetuned-fused-simplified-default

Text Generation • 77.3M • Updated Feb 10, 2025 • 3

asjoberg/openELM-450B-instruct-finetuned

71.5M • Updated Feb 10, 2025 • 5

asjoberg/openELM-270M-instruct-finetuned

42.5M • Updated Feb 11, 2025 • 4

sheenrooff/Llama-3.2-1B-Instruct-4bit-adapters-ff-test

Text Generation • 0.2B • Updated Feb 10, 2025 • 7

asjoberg/openELM-270M-instruct-finetuned-finetuned-fused-simplified-default

42.5M • Updated Feb 11, 2025 • 4

asjoberg/openELM-270M-instruct-finetuned-finetuned-fused16f-simplified-default

0.3B • Updated Feb 11, 2025 • 4

SilverFan/Llama-3.2-3B-RRP-V0.2-Q6-mlx

Text Generation • 0.7B • Updated Feb 11, 2025 • 8

mradermacher/Glyphstral-24b-v1-GGUF

24B • Updated Feb 13, 2025 • 44