Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,862

Base only

Active filters: mlx

sosoai/beomi-gemma-ko-2b-mlx

Text Generation • 0.8B • Updated Apr 23, 2024 • 6

mlx-community/zephyr-orpo-141b-A35b-v0.1-4bit

22B • Updated Apr 12, 2024 • 11 • 2

mlx-community/mixtral-8x22b-instruct-oh-4bit

22B • Updated Apr 17, 2024 • 55

mlx-community/rho-math-1b-v0.1-4bit

Text Generation • 0.2B • Updated Apr 12, 2024 • 20 • 1

mlx-community/rho-math-7b-v0.1-4bit

Text Generation • 1B • Updated Apr 15, 2024 • 8

mlx-community/rho-math-7b-interpreter-v0.1-4bit

Text Generation • 1B • Updated Apr 15, 2024 • 14 • 1

mlx-community/rho-math-1b-interpreter-v0.1-4bit

Text Generation • 0.2B • Updated Apr 15, 2024 • 11 • 1

GreenBitAI/Qwen-1.5-0.5B-Chat-layer-mix-bpw-2.2-mlx

0.3B • Updated Apr 12, 2024 • 18

GreenBitAI/Qwen-1.5-0.5B-Chat-layer-mix-bpw-2.5-mlx

0.3B • Updated Apr 12, 2024 • 5

GreenBitAI/Qwen-1.5-0.5B-Chat-layer-mix-bpw-3.0-mlx

0.3B • Updated Apr 12, 2024 • 6

GreenBitAI/Qwen-1.5-1.8B-Chat-layer-mix-bpw-2.2-mlx

0.7B • Updated Apr 12, 2024 • 9

mlx-community/zephyr-orpo-141b-A35b-v0.1-8bit

40B • Updated Apr 16, 2024 • 11

nishide-dev/suzume-poc-mlx-4bit

Text Generation • 0.8B • Updated Apr 13, 2024 • 9

mlx-community/openthaigpt-1.0.0-7b-chat-4bit-mlx

Text Generation • 1B • Updated Apr 13, 2024 • 8

mlx-community/Mistral-22B-v0.2-4bit

4B • Updated Apr 15, 2024 • 14

GreenBitAI/Qwen-1.5-4B-Chat-layer-mix-bpw-2.2-mlx

1B • Updated Apr 13, 2024 • 6

GreenBitAI/Qwen-1.5-4B-Chat-layer-mix-bpw-2.5-mlx

1B • Updated Apr 13, 2024 • 4

GreenBitAI/Qwen-1.5-4B-Chat-layer-mix-bpw-3.0-mlx

1B • Updated Apr 13, 2024 • 8

GreenBitAI/Qwen-1.5-1.8B-Chat-layer-mix-bpw-3.0-mlx

0.8B • Updated Apr 13, 2024 • 9

GreenBitAI/Qwen-1.5-1.8B-Chat-layer-mix-bpw-2.5-mlx

0.7B • Updated Apr 13, 2024 • 12

GreenBitAI/Qwen-1.5-7B-Chat-layer-mix-bpw-3.0-mlx

2B • Updated Apr 14, 2024 • 8

GreenBitAI/Qwen-1.5-7B-Chat-layer-mix-bpw-2.2-mlx

2B • Updated Apr 14, 2024 • 5

GreenBitAI/Qwen-1.5-7B-Chat-layer-mix-bpw-2.5-mlx

2B • Updated Apr 14, 2024 • 4

nishide-dev/suzume-poc-mlx-8bit

Text Generation • 1B • Updated Apr 13, 2024 • 6

mlx-community/mistral-22B-v0.2-8bit-mlx

6B • Updated Apr 13, 2024 • 7

mlx-community/Qwen1.5-72B-4bit

Text Generation • 12B • Updated Apr 13, 2024 • 11

GreenBitAI/Qwen-1.5-14B-Chat-layer-mix-bpw-2.5-mlx

3B • Updated Apr 13, 2024 • 7

GreenBitAI/Qwen-1.5-14B-Chat-layer-mix-bpw-3.0-mlx

3B • Updated Apr 13, 2024 • 7

GreenBitAI/Qwen-1.5-14B-Chat-layer-mix-bpw-2.2-mlx

3B • Updated Apr 13, 2024 • 8

GreenBitAI/Mistral-7B-Instruct-v0.2-layer-mix-bpw-2.2-mlx

0.9B • Updated Apr 14, 2024 • 4