Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,881

Base only

Active filters: mlx

mlx-community/granite-20b-code-base-4bit

Text Generation • 3B • Updated May 14, 2024 • 9

mlx-community/granite-20b-code-base-8bit

Text Generation • 6B • Updated May 14, 2024 • 11

mlx-community/granite-34b-code-base-4bit

Text Generation • 5B • Updated May 14, 2024 • 14 • 1

mlx-community/granite-34b-code-base-8bit

Text Generation • 9B • Updated May 14, 2024 • 11 • 1

mlx-community/granite-34b-code-instruct-4bit

Text Generation • 5B • Updated May 14, 2024 • 13 • 1

mlx-community/granite-34b-code-instruct-8bit

Text Generation • 9B • Updated May 14, 2024 • 8

batmac/gemma-1.1-7b-it-mlx-4bit

Text Generation • 1B • Updated May 6, 2024 • 6

batmac/gemma-1.1-7b-it-mlx-8bit

Text Generation • 2B • Updated May 7, 2024 • 6

batmac/gemma-1.1-2b-it-mlx-8bit

Text Generation • 0.7B • Updated May 7, 2024 • 6

mlx-community/Mistral7B-PairRM-SPPO-Iter3-unquantized

Text Generation • 7B • Updated May 7, 2024 • 15 • 1

mlx-community/karakuri-lm-8x7b-chat-v0.1-8bit

Text Generation • 13B • Updated May 7, 2024 • 26 • 1

SadokBarbouche/gemma-1.1-2b-it-quantized

Text Generation • 0.8B • Updated May 8, 2024 • 9

mlx-community/Llama-3-Refueled-unquantized

Text Generation • 8B • Updated May 8, 2024 • 5 • 1

uirev/MLX-gemma-Code-Instruct-Finetune-test

Text Generation • 0.8B • Updated May 9, 2024 • 26

mlx-community/typhoon-v1.5-8b-instruct-4bit-mlx

Text Generation • 1B • Updated May 9, 2024 • 25

mlx-community/defog-llama-3-sqlcoder-8b

Text Generation • 8B • Updated May 10, 2024 • 32 • 1

mlx-community/dolphin-2.9.1-llama-3-8b-2bit

0.8B • Updated May 10, 2024 • 14

mlx-community/dolphin-2.9.1-llama-3-8b-4bit

1B • Updated May 10, 2024 • 14

mlx-community/dolphin-2.9.1-llama-3-8b-8bit

2B • Updated May 10, 2024 • 12

mlx-community/bert-base-multilingual-uncased

Updated May 10, 2024 • 1

sosoai/hansoldeco-llama3-8b-v0.1-mlx

1B • Updated May 13, 2024 • 6

cogbuji/Llama-3-Mr-Grammatology-clinical-problems-0.6

Text Generation • 2B • Updated May 11, 2024 • 13 • 1

sosoai/hansoldeco-phi3-4k-instruct-v0.1-mlx

0.6B • Updated May 13, 2024 • 5

ucalyptus/prem-1B-chat-MLX

Text Generation • 0.2B • Updated May 11, 2024 • 10 • 1

voxmenthe/Meta-Llama-3-70B-Instruct-8bit

Text Generation • 20B • Updated May 12, 2024 • 16

mlx-community/Yi-1.5-6B-4bit

0.9B • Updated May 13, 2024 • 18

mlx-community/Yi-1.5-6B-8bit

2B • Updated May 13, 2024 • 14

mlx-community/Yi-1.5-6B-Chat-4bit

0.9B • Updated May 13, 2024 • 10

mlx-community/Yi-1.5-6B-Chat-8bit

2B • Updated May 13, 2024 • 2

mlx-community/Yi-1.5-9B-Chat-8bit

2B • Updated May 13, 2024 • 7 • 1