Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,893

Base only

Active filters: mlx

mlx-community/stockmark-100b-4bit

Text Generation • 15B • Updated May 16, 2024 • 14

ucalyptus/llama-3-sqlcoder-8b-MLX

Text Generation • 2B • Updated May 17, 2024 • 19 • 1

ucalyptus/sqlcoder-7b-2-MLX

Text Generation • 1B • Updated May 17, 2024 • 21 • 1

mlx-community/dolphin-2.9.1-yi-1.5-34b-2bit

3B • Updated May 18, 2024 • 10

mlx-community/dolphin-2.9.1-yi-1.5-34b-4bit

5B • Updated May 18, 2024 • 12 • 1

mlx-community/dolphin-2.9.1-yi-1.5-34b-8bit

10B • Updated May 18, 2024 • 9

mlx-community/dolphin-2.9.1-yi-9b-2bit

0.8B • Updated May 18, 2024 • 13 • 1

mlx-community/dolphin-2.9.1-yi-9b-4bit

1B • Updated May 18, 2024 • 8

mlx-community/dolphin-2.9.1-yi-9b-8bit

2B • Updated May 18, 2024 • 8

mlx-community/Master-Yi-9B-4bit

1B • Updated May 19, 2024 • 6 • 1

voxmenthe/Smaug-Llama-3-70B-Instruct-mlx-8bit

Text Generation • 20B • Updated May 19, 2024 • 15

mlx-community/Master-Yi-9B-8bit

2B • Updated May 19, 2024 • 4 • 2

voxmenthe/Yi-1.5-34B-Chat-16K-8bit

10B • Updated May 20, 2024 • 9 • 1

JosefAlbers/phi-3-medmcqa-openbiollm

Text Generation • Updated May 20, 2024

massimilianowosz/gemma-2b-it-japanese-chef-mlx

Text Generation • 3B • Updated May 21, 2024 • 11

mlx-community/Phi-3-medium-128k-instruct-4bit

Text Generation • 2B • Updated Jul 11, 2024 • 44 • 2

mlx-community/Phi-3-medium-128k-instruct-8bit

Text Generation • 4B • Updated Jul 11, 2024 • 25 • 2

mlx-community/Phi-3-medium-4k-instruct-4bit

Text Generation • 2B • Updated Jul 11, 2024 • 16

mlx-community/Phi-3-medium-4k-instruct-8bit

Text Generation • 4B • Updated Jul 11, 2024 • 10

dwightf/BerkshireGPTMLX

7B • Updated May 22, 2024 • 3

mlx-community/dolphin-2.9.1-llama-3-70b-2bit

7B • Updated May 22, 2024 • 22

mlx-community/Mistral-7B-v0.3-4bit

1B • Updated May 22, 2024 • 88 • 2

mlx-community/Mistral-7B-Instruct-v0.3-8bit

2B • Updated May 22, 2024 • 145 • 3

mlx-community/Mistral-7B-Instruct-v0.3-4bit

1B • Updated Jun 18, 2024 • 17.1k • 10

mlx-community/dolphin-2.9.1-llama-3-70b-4bit

11B • Updated May 22, 2024 • 24 • 1

mlx-community/dolphin-2.9.1-llama-3-70b-8bit

20B • Updated May 22, 2024 • 35

mlx-community/dolphin-2.9.1-mixtral-1x22b-2bit

2B • Updated May 22, 2024 • 26

mlx-community/dolphin-2.9.1-mixtral-1x22b-4bit

3B • Updated May 22, 2024 • 29

mlx-community/dolphin-2.9.1-mixtral-1x22b-8bit

6B • Updated May 22, 2024 • 29

sosoai/hansoldeco-mistral-7b-v0.3-v0.1-mlx

1B • Updated May 23, 2024 • 4