Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16,242

Base only

Active filters: mlx

GreenBitAI/Qwen-1.5-14B-layer-mix-bpw-2.2-mlx

3B • Updated Apr 9, 2024 • 3

GreenBitAI/Qwen-1.5-7B-layer-mix-bpw-2.5-mlx

2B • Updated Apr 9, 2024 • 10

mlx-community/codegemma-7b-it-8bit

Text Generation • Updated Apr 9, 2024 • 239 • 6

GreenBitAI/Qwen-1.5-4B-layer-mix-bpw-2.5-mlx

1B • Updated Apr 9, 2024 • 5

GreenBitAI/01-Yi-6B-layer-mix-bpw-2.5-mlx

1B • Updated Apr 9, 2024 • 4

GreenBitAI/01-Yi-34B-layer-mix-bpw-2.5-mlx

4B • Updated Apr 10, 2024 • 13

GreenBitAI/Llama-2-7B-layer-mix-bpw-2.5-mlx

0.9B • Updated Apr 10, 2024 • 14

GreenBitAI/Llama-2-13B-layer-mix-bpw-2.5-mlx

2B • Updated Apr 10, 2024 • 12

mlx-community/MiniCPM-2B-sft-4bit-llama-format-mlx

Updated Apr 10, 2024 • 62 • 1

GreenBitAI/Mistral-7B-v0.1-layer-mix-bpw-2.5-mlx

1.0B • Updated Apr 10, 2024 • 8

mlx-community/Mixtral-8x22B-4bit

22B • Updated Apr 10, 2024 • 736 • 55

GreenBitAI/Qwen-1.5-32B-layer-mix-bpw-2.5-mlx

5B • Updated Apr 10, 2024 • 7

GreenBitAI/Qwen-1.5-32B-layer-mix-bpw-3.0-mlx

5B • Updated Apr 11, 2024 • 4

mlx-community/phi-2-orange-v2

Updated Apr 11, 2024 • 17 • 1

GreenBitAI/Qwen-1.5-32B-layer-mix-bpw-2.2-mlx

5B • Updated Apr 11, 2024 • 8

mlx-community/Mistral-22B-v0.1-4bit-MLX

Updated Apr 11, 2024 • 32 • 1

mlx-community/c4ai-command-r-plus-8bit

Text Generation • Updated Apr 12, 2024 • 105 • 3

sosoai/beomi-gemma-ko-2b-mlx

Text Generation • 0.8B • Updated Apr 23, 2024 • 6

mlx-community/zephyr-orpo-141b-A35b-v0.1-4bit

Updated Apr 12, 2024 • 17 • 2

mlx-community/mixtral-8x22b-instruct-oh-4bit

Updated Apr 17, 2024 • 32

mlx-community/rho-math-1b-v0.1-4bit

Text Generation • Updated Apr 12, 2024 • 36 • 1

mlx-community/rho-math-7b-v0.1-4bit

Text Generation • Updated Apr 15, 2024 • 17

mlx-community/rho-math-7b-interpreter-v0.1-4bit

Text Generation • Updated Apr 15, 2024 • 24 • 1

mlx-community/rho-math-1b-interpreter-v0.1-4bit

Text Generation • Updated Apr 15, 2024 • 21 • 1

GreenBitAI/Qwen-1.5-0.5B-Chat-layer-mix-bpw-2.2-mlx

0.3B • Updated Apr 12, 2024 • 11

GreenBitAI/Qwen-1.5-0.5B-Chat-layer-mix-bpw-2.5-mlx

0.3B • Updated Apr 12, 2024 • 9

GreenBitAI/Qwen-1.5-0.5B-Chat-layer-mix-bpw-3.0-mlx

0.3B • Updated Apr 12, 2024 • 4

GreenBitAI/Qwen-1.5-1.8B-Chat-layer-mix-bpw-2.2-mlx

0.7B • Updated Apr 12, 2024 • 6

mlx-community/zephyr-orpo-141b-A35b-v0.1-8bit

Updated Apr 16, 2024 • 11

nishide-dev/suzume-poc-mlx-4bit

Text Generation • 0.8B • Updated Apr 13, 2024 • 7