Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,824

Base only

Active filters: mlx

mlx-community/pandafish-dt-7b-4bit

1B • Updated Apr 6, 2024 • 16 • 2

mlx-community/Qwen1.5-32B-Chat-4bit

Text Generation • 6B • Updated Apr 5, 2024 • 10 • 3

mlx-community/Qwen1.5-32B-Chat-8bit

Text Generation • 10B • Updated Apr 5, 2024 • 11 • 1

mlx-community/gemma-1.1-7b-it-4bit

Text Generation • 2B • Updated Apr 8, 2024 • 46 • 4

mlx-community/gemma-1.1-2b-it-4bit

Text Generation • 0.8B • Updated Apr 5, 2024 • 138 • 3

mlx-vision/vit_small_patch8_224.dino-mlxim

Image Classification • 21.7M • Updated Apr 6, 2024 • 2

mlx-vision/vit_small_patch14_518.dinov2-mlxim

Image Classification • 22M • Updated Apr 6, 2024 • 66

mlx-vision/vit_base_patch8_224.dino-mlxim

Image Classification • 85.8M • Updated Apr 6, 2024 • 3

mlx-vision/vit_base_patch16_224.dino-mlxim

Image Classification • 85.8M • Updated Apr 6, 2024 • 5 • 1

mlx-vision/vit_small_patch16_224.dino-mlxim

Image Classification • 21.7M • Updated Apr 6, 2024 • 140

mlx-vision/vit_base_patch14_518.dinov2-mlxim

Image Classification • 86.6M • Updated Apr 6, 2024 • 339

mlx-vision/vit_large_patch14_518.dinov2-mlxim

Image Classification • 0.3B • Updated Apr 6, 2024 • 113 • 1

GreenBitAI/yi-6b-chat-w4a16g32-mlx

2B • Updated Apr 6, 2024 • 7

GreenBitAI/yi-6b-chat-w4a16g128-mlx

1B • Updated Apr 6, 2024 • 4

GreenBitAI/01-Yi-6B-layer-mix-bpw-2.2-mlx

1B • Updated Apr 6, 2024 • 6

GreenBitAI/yi-6b-w4a16g32-mlx

2B • Updated Apr 6, 2024 • 16 • 1

mlx-community/dolphin-2.8-mistral-7b-v02

7B • Updated Apr 6, 2024 • 55 • 1

mlx-community/dolphin-2.8-mistral-7b-v02-4bit

1B • Updated Apr 6, 2024 • 43

GreenBitAI/01-Yi-6B-layer-mix-bpw-3.0-mlx

1B • Updated Apr 6, 2024 • 8

mlx-community/dolphin-2.8-mistral-7b-v02-8bit

2B • Updated Apr 6, 2024 • 21

GreenBitAI/Mistral-7B-v0.1-layer-mix-bpw-3.0-mlx

1B • Updated Apr 6, 2024 • 6

GreenBitAI/Mistral-7B-v0.1-layer-mix-bpw-2.2-mlx

0.9B • Updated Apr 6, 2024 • 5

GreenBitAI/Llama-2-7B-layer-mix-bpw-2.2-mlx

0.9B • Updated Apr 6, 2024 • 7

GreenBitAI/Llama-2-7B-layer-mix-bpw-3.0-mlx

1B • Updated Apr 6, 2024 • 7

GreenBitAI/Mistral-7B-Instruct-v0.2-layer-mix-bpw-3.0-mlx

1B • Updated Apr 14, 2024 • 7

GreenBitAI/01-Yi-6B-chat-layer-mix-bpw-2.2-mlx

1B • Updated Apr 14, 2024 • 3

mlx-community/dolphin-2.7-mixtral-8x7b

47B • Updated Apr 6, 2024 • 28

GreenBitAI/01-Yi-6B-Chat-layer-mix-bpw-3.0-mlx

1B • Updated Apr 14, 2024 • 5

GreenBitAI/Llama-2-13B-layer-mix-bpw-2.2-mlx

2B • Updated Apr 6, 2024 • 3

GreenBitAI/Llama-2-13B-layer-mix-bpw-3.0-mlx

2B • Updated Apr 6, 2024 • 4