Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,872

Base only

Active filters: mlx

mlx-community/dolphin-2.9.1-mixtral-1x22b-8bit

6B • Updated May 22, 2024 • 29

sosoai/hansoldeco-mistral-7b-v0.3-v0.1-mlx

1B • Updated May 23, 2024 • 4

mlx-community/aya-23-8B-4bit

Text Generation • 1B • Updated May 23, 2024 • 42 • 2

mlx-community/aya-23-8B-8bit

Text Generation • 2B • Updated May 23, 2024 • 20 • 1

mlx-community/aya-23-35B-4bit

Text Generation • 5B • Updated May 23, 2024 • 28 • 1

mlx-community/aya-23-35B-8bit

Text Generation • 10B • Updated May 23, 2024 • 34 • 2

lmbelo/Meta-Llama-3-8B-Function-Calling

Text Generation • 8B • Updated May 23, 2024 • 10

lmbelo/OpenELM-270M-Instruct

0.3B • Updated May 25, 2024 • 4

mlx-community/Phi-3-mini-4k-instruct-unsloth-4bit

Text Generation • 0.6B • Updated May 24, 2024 • 85 • 2

mlx-community/JOSIE-TinyLlama-1.1B-32k-base-4bit

Text Generation • 0.2B • Updated May 24, 2024 • 35 • 1

mlx-community/JOSIE-TinyLlama-1.1B-32k-base-8bit

Text Generation • 0.3B • Updated May 24, 2024 • 11 • 1

mlx-community/Phi-3-small-8k-instruct-aq4_64

Text Generation • 1B • Updated May 24, 2024 • 8

mlx-community/openchat-3.6-8b-20240522-8bit

Text Generation • 2B • Updated May 24, 2024 • 12 • 2

mlx-community/openchat-3.6-8b-20240522-4bit

Text Generation • 1B • Updated May 24, 2024 • 14 • 1

mlx-community/openchat-3.6-8b-20240522-2bit

Text Generation • 0.8B • Updated May 24, 2024 • 11

lmbelo/OpenELM-270M-Function-Calling

0.3B • Updated May 25, 2024 • 8

cstr/Llama3-DiscoLeo-Instruct-8B-v0.1-mlx

Text Generation • 1B • Updated 15 days ago • 183

dfurman/Mistral-7B-Instruct-v0.3-mlx-4bit

1B • Updated May 26, 2024 • 40

mayflowergmbh/Llama3-German-8B-4bit

Text Generation • 2B • Updated May 26, 2024 • 14

mayflowergmbh/Llama3-German-8B-32k-4bit

Text Generation • 2B • Updated May 26, 2024 • 34 • 1

mayflowergmbh/Llama3-DiscoLeo-Instruct-8B-v0.1-4bit

Text Generation • 2B • Updated May 26, 2024 • 8

mayflowergmbh/Llama3-DiscoLeo-Instruct-8B-32k-v0.1-4bit

Text Generation • 2B • Updated May 26, 2024 • 7

mlx-community/OpenELM-270M-Instruct-4bit

42.5M • Updated May 26, 2024 • 7 • 1

lmbelo/Phi-3-mini-4k-instruct

Text Generation • 4B • Updated May 28, 2024 • 10

cstr/llama3-8b-spaetzle-v33-mlx-4bit

1B • Updated 15 days ago • 406

mlx-community/Codestral-22B-v0.1-4bit

3B • Updated May 29, 2024 • 1.02k • 13

mlx-community/Codestral-22B-v0.1-8bit

6B • Updated May 29, 2024 • 298 • 8

lmbelo/Phi-3-mini-4k-Function-Calling

Text Generation • 4B • Updated May 30, 2024 • 10

mlx-community/AutoCoder-33B-4bit

5B • Updated May 30, 2024 • 22 • 2

xiaotianxt/llama-3-chinese-8b-instruct-v3-4bit-mlx

1B • Updated May 31, 2024 • 12