Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,006

Base only

Active filters: chat

gaianet/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 346 • 2

apto-as/Qwen2.5-Coder-7B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Nov 10, 2024 • 127

second-state/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 11, 2024 • 258

gaianet/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 11, 2024 • 285

SufficientPrune3897/magnum-v4-123b-exl2-RPCAL-2.6bpw

Text Generation • Updated Mar 19 • 2

tensorblock/Qwen2-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 27 • 11

d4n33l/qwen2.5-coder-1.5b-it-pii

Text Generation • 2B • Updated Nov 11, 2024

tensorblock/Qwen1.5-7B-Chat-GGUF

Text Generation • 8B • Updated Jan 27 • 61

tensorblock/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jan 27 • 137

lucyknada/theo77186_Qwen2.5-Coder-7B-Instruct-20241106-exl2

Text Generation • Updated Nov 11, 2024

tensorblock/Qwen1.5-32B-Chat-GGUF

Text Generation • 33B • Updated Jan 27 • 8

tensorblock/Qwen1.5-1.8B-Chat-GGUF

Text Generation • 2B • Updated Jan 27 • 26

JackeyLai/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 612 • 2

second-state/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Nov 11, 2024 • 340

gaianet/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Nov 11, 2024 • 132

tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jan 27 • 110

deeptoken/Qwen2.5-3B-RuoZhiBa-Instruct

Text Generation • 3B • Updated Nov 11, 2024 • 11 • 1

mlx-community/Qwen2.5-Coder-32B-Instruct-bf16

Text Generation • Updated Nov 11, 2024 • 349 • 11

mlx-community/Qwen2.5-Coder-32B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 954 • 14

mlx-community/Qwen2.5-Coder-32B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 1.94k • 12

mlx-community/Qwen2.5-Coder-14B-Instruct-bf16

Text Generation • Updated Nov 11, 2024 • 474 • 2

mlx-community/Qwen2.5-Coder-14B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 3.69k • 10

mlx-community/Qwen2.5-Coder-14B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 1.05k • 2

mlx-community/Qwen2.5-Coder-3B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 1.21k • 3

mlx-community/Qwen2.5-Coder-3B-Instruct-bf16

Text Generation • Updated Nov 11, 2024 • 103 • 2

mlx-community/Qwen2.5-Coder-3B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 2.63k • 4

mlx-community/Qwen2.5-Coder-0.5B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 3.34k • 6

mlx-community/Qwen2.5-Coder-0.5B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 76 • 1

mlx-community/Qwen2.5-Coder-0.5B-Instruct-bf16

Text Generation • Updated Nov 11, 2024 • 67 • 1

lmstudio-community/Qwen2.5-0.5B-Instruct-MLX-4bit

Text Generation • 77.3M • Updated Nov 13, 2024 • 9.37k • 1