Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16,231

Base only

Active filters: mlx

mlx-community/Llama-3.1-Swallow-8B-Instruct-v0.2-4bit

Text Generation • 1B • Updated Nov 11, 2024 • 26

mlx-community/Llama-3.1-Swallow-8B-Instruct-v0.2-8bit

Text Generation • 2B • Updated Nov 11, 2024 • 18

mlx-community/Llama-3.1-Swallow-8B-Instruct-v0.2

Text Generation • 8B • Updated Nov 11, 2024 • 15

tensorblock/SmolLM-360M-Instruct-GGUF

0.4B • Updated Jan 27 • 17

mlx-community/Qwen2.5-Coder-32B-Instruct-bf16

Text Generation • Updated Nov 11, 2024 • 509 • 11

mlx-community/Qwen2.5-Coder-32B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 868 • 13

mlx-community/Qwen2.5-Coder-32B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 2.64k • 12

mlx-community/Qwen2.5-Coder-32B-4bit

Text Generation • Updated Nov 12, 2024 • 129 • 3

mlx-community/Qwen2.5-Coder-32B-8bit

Text Generation • Updated Nov 12, 2024 • 142 • 4

mlx-community/Qwen2.5-Coder-32B-bf16

Text Generation • Updated Nov 12, 2024 • 46 • 1

mlx-community/Qwen2.5-Coder-14B-Instruct-bf16

Text Generation • Updated Nov 11, 2024 • 141 • 2

mlx-community/Qwen2.5-Coder-14B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 3.28k • 8

mlx-community/Qwen2.5-Coder-14B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 267 • 2

mlx-community/Qwen2.5-Coder-3B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 174 • 3

mlx-community/Qwen2.5-Coder-3B-Instruct-bf16

Text Generation • Updated Nov 11, 2024 • 74 • 2

mlx-community/Qwen2.5-Coder-3B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 1.82k • 4

mlx-community/Qwen2.5-Coder-0.5B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 839 • 6

mlx-community/Qwen2.5-Coder-0.5B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 44 • 1

mlx-community/Qwen2.5-Coder-0.5B-Instruct-bf16

Text Generation • Updated Nov 11, 2024 • 32 • 1

mlx-community/Qwen2.5-Coder-0.5B-bf16

Text Generation • Updated Nov 11, 2024 • 16

mlx-community/Qwen2.5-Coder-0.5B-8bit

Text Generation • Updated Nov 11, 2024 • 24

mlx-community/Qwen2.5-Coder-0.5B-4bit

Text Generation • Updated Nov 11, 2024 • 119

mlx-community/Qwen2.5-Coder-3B-4bit

Text Generation • Updated Nov 12, 2024 • 216 • 1

mlx-community/Qwen2.5-Coder-3B-8bit

Text Generation • Updated Nov 11, 2024 • 112 • 1

mlx-community/Qwen2.5-Coder-3B-bf16

Text Generation • Updated Nov 11, 2024 • 51

mlx-community/Qwen2.5-Coder-14B-bf16

Text Generation • Updated Nov 12, 2024 • 65 • 1

mlx-community/Qwen2.5-Coder-14B-4bit

Text Generation • Updated Nov 12, 2024 • 140

mlx-community/Qwen2.5-Coder-14B-8bit

Text Generation • Updated Nov 12, 2024 • 73

lmstudio-community/Qwen2.5-0.5B-Instruct-MLX-4bit

Text Generation • 77.3M • Updated Nov 13, 2024 • 12.5k • 1

lmstudio-community/Qwen2.5-0.5B-Instruct-MLX-8bit

Text Generation • 0.1B • Updated Nov 13, 2024 • 374