Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,832

Base only

Active filters: mlx

mweinbach/gemma-1.1-7b-it-mlx

Text Generation • 9B • Updated Apr 9, 2024 • 8

GreenBitAI/Qwen-1.5-14B-layer-mix-bpw-3.0-mlx

3B • Updated Apr 9, 2024 • 10

GreenBitAI/Qwen-1.5-14B-layer-mix-bpw-2.2-mlx

3B • Updated Apr 9, 2024 • 5

GreenBitAI/Qwen-1.5-7B-layer-mix-bpw-2.5-mlx

2B • Updated Apr 9, 2024 • 8

mlx-community/codegemma-7b-it-8bit

Text Generation • 3B • Updated Apr 9, 2024 • 168 • 6

GreenBitAI/Qwen-1.5-4B-layer-mix-bpw-2.5-mlx

1B • Updated Apr 9, 2024 • 8

GreenBitAI/01-Yi-6B-layer-mix-bpw-2.5-mlx

1B • Updated Apr 9, 2024 • 6

GreenBitAI/01-Yi-34B-layer-mix-bpw-2.5-mlx

4B • Updated Apr 10, 2024 • 5

GreenBitAI/Llama-2-7B-layer-mix-bpw-2.5-mlx

0.9B • Updated Apr 10, 2024 • 4

GreenBitAI/Llama-2-13B-layer-mix-bpw-2.5-mlx

2B • Updated Apr 10, 2024 • 4

mlx-community/MiniCPM-2B-sft-4bit-llama-format-mlx

0.7B • Updated Apr 10, 2024 • 26 • 1

GreenBitAI/Mistral-7B-v0.1-layer-mix-bpw-2.5-mlx

1.0B • Updated Apr 10, 2024 • 4

mlx-community/Mixtral-8x22B-4bit

22B • Updated Apr 10, 2024 • 388 • 55

GreenBitAI/Qwen-1.5-32B-layer-mix-bpw-2.5-mlx

5B • Updated Apr 10, 2024 • 7

GreenBitAI/Qwen-1.5-32B-layer-mix-bpw-3.0-mlx

5B • Updated Apr 11, 2024 • 7

mlx-community/phi-2-orange-v2

0.5B • Updated Apr 11, 2024 • 5 • 1

GreenBitAI/Qwen-1.5-32B-layer-mix-bpw-2.2-mlx

5B • Updated Apr 11, 2024 • 7

mlx-community/Mistral-22B-v0.1-4bit-MLX

1B • Updated Apr 11, 2024 • 19 • 1

mlx-community/c4ai-command-r-plus-8bit

Text Generation • 31B • Updated Apr 12, 2024 • 69 • 3

sosoai/beomi-gemma-ko-2b-mlx

Text Generation • 0.8B • Updated Apr 23, 2024 • 6

mlx-community/zephyr-orpo-141b-A35b-v0.1-4bit

22B • Updated Apr 12, 2024 • 11 • 2

mlx-community/mixtral-8x22b-instruct-oh-4bit

22B • Updated Apr 17, 2024 • 55

mlx-community/rho-math-1b-v0.1-4bit

Text Generation • 0.2B • Updated Apr 12, 2024 • 20 • 1

mlx-community/rho-math-7b-v0.1-4bit

Text Generation • 1B • Updated Apr 15, 2024 • 8

mlx-community/rho-math-7b-interpreter-v0.1-4bit

Text Generation • 1B • Updated Apr 15, 2024 • 14 • 1

mlx-community/rho-math-1b-interpreter-v0.1-4bit

Text Generation • 0.2B • Updated Apr 15, 2024 • 11 • 1

GreenBitAI/Qwen-1.5-0.5B-Chat-layer-mix-bpw-2.2-mlx

0.3B • Updated Apr 12, 2024 • 18

GreenBitAI/Qwen-1.5-0.5B-Chat-layer-mix-bpw-2.5-mlx

0.3B • Updated Apr 12, 2024 • 5

GreenBitAI/Qwen-1.5-0.5B-Chat-layer-mix-bpw-3.0-mlx

0.3B • Updated Apr 12, 2024 • 6

GreenBitAI/Qwen-1.5-1.8B-Chat-layer-mix-bpw-2.2-mlx

0.7B • Updated Apr 12, 2024 • 9