Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,837

Base only

Active filters: mlx

mlx-community/Llama-3-8B-Instruct-Gradient-1048k-2bit

Text Generation • 0.8B • Updated May 5, 2024 • 7

mlx-community/Llama-3-8B-Instruct-Gradient-1048k-4bit

Text Generation • 1B • Updated May 5, 2024 • 11 • 2

mlx-community/Llama-3-8B-Instruct-Gradient-1048k-8bit

Text Generation • 2B • Updated May 5, 2024 • 12 • 1

mlx-community/Llama-3-8B-Instruct-262k-2bit

Text Generation • 0.8B • Updated May 5, 2024 • 14 • 1

mlx-community/ChimeraLlama-3-8B-v3-unquantized

8B • Updated May 5, 2024 • 7

mlx-community/Meta-Llama-3-120B-Instruct-4bit

19B • Updated May 5, 2024 • 26 • 1

Goekdeniz-Guelmez/MiniCPM-2B-dpo-fp32-safetensors

3B • Updated May 6, 2024 • 48 • 1

Goekdeniz-Guelmez/MiniCPM-2B-sft-fp32-safetensors

3B • Updated May 6, 2024 • 15 • 1

Goekdeniz-Guelmez/MiniCPM-2B-dpo-bf16-safetensors

3B • Updated May 6, 2024 • 44 • 1

mlx-community/MiniCPM-2B-dpo-bf16-4bit

0.5B • Updated May 6, 2024 • 24 • 1

mlx-community/MiniCPM-2B-dpo-bf16

0.5B • Updated May 6, 2024 • 17

mlx-community/idefics2-8b-chatty-4bit

Image-Text-to-Text • 1B • Updated Jan 29, 2025 • 45

mlx-community/idefics2-8b-chatty-8bit

Image-Text-to-Text • 2B • Updated Jan 29, 2025 • 15 • 1

GusLovesMath/LlaMATH-3-8B-Instruct-4bit

Text Generation • 2B • Updated Jan 12, 2025 • 6

batmac/Meta-Llama-Guard-2-8B-mlx-4bit

Text Generation • 1B • Updated May 6, 2024 • 14

mlx-community/granite-8b-code-base-4bit

Text Generation • 1B • Updated May 6, 2024 • 14

mlx-community/granite-8b-code-base-8bit

Text Generation • 1B • Updated May 6, 2024 • 18 • 1

mlx-community/granite-3b-code-base-4bit

Text Generation • 0.5B • Updated May 6, 2024 • 14

mlx-community/granite-3b-code-base-8bit

Text Generation • 1.0B • Updated May 6, 2024 • 12

mlx-community/granite-3b-code-instruct-4bit

Text Generation • 0.5B • Updated May 6, 2024 • 37

mlx-community/granite-3b-code-instruct-8bit

Text Generation • 1.0B • Updated May 6, 2024 • 18

mlx-community/granite-8b-code-instruct-4bit

Text Generation • 1B • Updated May 6, 2024 • 35

mlx-community/granite-8b-code-instruct-8bit

Text Generation • 2B • Updated May 6, 2024 • 13

mlx-community/granite-20b-code-instruct-4bit

Text Generation • 3B • Updated May 14, 2024 • 17

mlx-community/granite-20b-code-instruct-8bit

Text Generation • 6B • Updated May 14, 2024 • 11

mlx-community/granite-20b-code-base-4bit

Text Generation • 3B • Updated May 14, 2024 • 9

mlx-community/granite-20b-code-base-8bit

Text Generation • 6B • Updated May 14, 2024 • 11

mlx-community/granite-34b-code-base-4bit

Text Generation • 5B • Updated May 14, 2024 • 13 • 1

mlx-community/granite-34b-code-base-8bit

Text Generation • 9B • Updated May 14, 2024 • 10 • 1

mlx-community/granite-34b-code-instruct-4bit

Text Generation • 5B • Updated May 14, 2024 • 13 • 1