Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,258

Base only

Active filters: mlx

mlx-community/Sky-T1-32B-Preview-4bit

Text Generation • 5B • Updated Jan 13, 2025 • 12

CuckmeisterFuller/phi-4-Q2-mlx

Text Generation • 1B • Updated Jan 13, 2025 • 6

CuckmeisterFuller/Cydonia-v1.2-Magnum-v4-22B-Q2-mlx

Text Generation • 2B • Updated Jan 13, 2025 • 130

CuckmeisterFuller/Cydonia-v1.3-Magnum-v4-22B-Q3-mlx

Text Generation • 3B • Updated Jan 13, 2025 • 79

CuckmeisterFuller/Cydonia-22B-v1.3-Q3-mlx

3B • Updated Jan 14, 2025 • 20

CuckmeisterFuller/Cydonia-22B-v1.2-Q2-mlx

2B • Updated Jan 14, 2025 • 17

twire2024/gemma-2-2b-jpn-it-4bit

Text Generation • 0.4B • Updated Jan 14, 2025 • 9

CuckmeisterFuller/Cydonia-22B-v1.3-Q2-mlx

2B • Updated Jan 14, 2025 • 18

cnfusion/Sky-T1-32B-Preview-Q6-mlx

Text Generation • 7B • Updated Jan 15, 2025 • 8

mlx-community/internlm3-8b-instruct-4bit

1B • Updated Jan 15, 2025 • 30 • 3

mlx-community/Qwen2.5-Aloe-Beta-7B

Question Answering • 1B • Updated Jan 15, 2025 • 276

mlx-community/Llama3-Med42-8B

Text Generation • 1B • Updated Jan 15, 2025 • 32 • 1

mlx-community/jinaai-ReaderLM-v2

0.2B • Updated Jan 17, 2025 • 205 • 25

bestler/Code-Summary-Llama-3.2-3B-Instruct

Text Generation • 3B • Updated Feb 9, 2025 • 52

surrenderoz/llama2_7_q4

Text Generation • 1B • Updated Jan 16, 2025 • 6

mlx-community/functionary-small-v3.2

1B • Updated Jan 16, 2025 • 15 • 2

jerryzhao173985/Qwen2.5-7B-poem-8bit

Text Generation • 2B • Updated Jan 17, 2025 • 7 • 1

juanpestana/phi-4-Q4-mlx

Text Generation • 2B • Updated Jan 17, 2025 • 6

mlx-community/Lucie-7B-Instruct-4bit

Text Generation • 1B • Updated Jan 17, 2025 • 24

mlx-community/helium-1-preview-2b

Text Generation • 2B • Updated Jan 18, 2025 • 6

mlx-community/helium-1-preview-2b-8bit

Text Generation • 0.6B • Updated Jan 18, 2025 • 10 • 1

mlx-community/helium-1-preview-2b-float32

Text Generation • 2B • Updated Jan 18, 2025 • 11

mlx-community/helium-1-preview-2b-4bit

Text Generation • 0.3B • Updated Jan 18, 2025 • 11 • 1

mlx-community/reader-lm-0.5b

Text Generation • 0.5B • Updated Jan 18, 2025 • 12

mlx-community/reader-lm-1.5b

Text Generation • 2B • Updated Jan 18, 2025 • 9 • 1

Jayden6820/gemma-2-2b-it

Text Generation • 3B • Updated Jan 19, 2025 • 7

mlx-community/SWE-Fixer-Editor-72B-4bit

Text Generation • 11B • Updated Jan 19, 2025 • 17

mlx-community/SWE-Fixer-Retriever-7B-4bit

Text Generation • 1B • Updated Jan 19, 2025 • 9

mlx-community/deepseek-r1-distill-qwen-1.5b

2B • Updated Feb 26, 2025 • 829 • 24

mlx-community/llama-3-youko-8b-instruct-4bit-mlx

1B • Updated Jan 20, 2025 • 6