Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,006

Base only

Active filters: chat

lmstudio-community/Qwen2.5-Coder-1.5B-Instruct-MLX-4bit

Text Generation • 0.2B • Updated Nov 13, 2024 • 2.64k

lmstudio-community/Qwen2.5-Coder-1.5B-Instruct-MLX-8bit

Text Generation • 0.4B • Updated Nov 13, 2024 • 7.54k • 1

lmstudio-community/Qwen2.5-Coder-0.5B-Instruct-MLX-4bit

Text Generation • 77.3M • Updated Nov 13, 2024 • 1.38k

lmstudio-community/Qwen2.5-Coder-0.5B-Instruct-MLX-8bit

Text Generation • 0.1B • Updated Nov 13, 2024 • 883

Volko76/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Nov 11, 2024 • 34

mradermacher/Qwen2.5-3B-RuoZhiBa-Instruct-GGUF

3B • Updated Nov 12, 2024 • 53

tensorblock/Qwen2-Math-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jan 27 • 28

tensorblock/llama-3-typhoon-v1.5-8b-instruct-GGUF

Text Generation • 8B • Updated Jan 27 • 27

tensorblock/Qwen2.5-32B-Instruct-GGUF

Text Generation • 33B • Updated Jan 27 • 102 • 1

tensorblock/Qwen1.5-4B-Chat-GGUF

Text Generation • 4B • Updated Jan 27 • 70

mradermacher/Qwen2.5-Coder-32B-Instruct-GGUF

33B • Updated Nov 12, 2024 • 112 • 2

tensorblock/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Jan 27 • 47 • 1

c01zaut/Qwen2.5-14B-Instruct-rk3588-1.1.1

Text Generation • Updated Nov 22, 2024 • 6

bartowski/Qwen2.5-Coder-32B-Instruct-exl2

Text Generation • Updated Nov 13, 2024 • 38 • 13

mradermacher/Qwen2.5-Coder-14B-Instruct-GGUF

15B • Updated Nov 12, 2024 • 285 • 1

lucyknada/Qwen_Qwen2.5-Coder-14B-Instruct-exl2

Text Generation • Updated Nov 12, 2024 • 2

QuantFactory/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 12, 2024 • 283 • 3

mradermacher/Qwen2.5-Coder-0.5B-Instruct-GGUF

0.5B • Updated Nov 12, 2024 • 210

mradermacher/Qwen2.5-Coder-1.5B-Instruct-GGUF

2B • Updated Nov 12, 2024 • 105

shanginn/Qwen2.5-Coder-32B-Instruct-mlx

Text Generation • 33B • Updated Nov 12, 2024 • 14

mradermacher/Qwen2.5-Coder-3B-Instruct-GGUF

3B • Updated Nov 12, 2024 • 158 • 1

mradermacher/Qwen2.5-Coder-7B-Instruct-GGUF

8B • Updated Nov 12, 2024 • 242

shanginn/Qwen2.5-Coder-32B-Instruct-mlx-q8

Text Generation • 9B • Updated Nov 12, 2024 • 36

Apel-sin/qwen2.5-coder-14b-instruct-exl2

Text Generation • Updated Nov 12, 2024

c01zaut/Qwen2.5-Coder-1.5B-Instruct-rk3588-1.1.1

Text Generation • Updated Nov 12, 2024 • 4

CISCai/Qwen2.5-Coder-32B-Instruct-SOTA-GGUF

Text Generation • 33B • Updated Jan 6, 2025 • 367 • 4

QuantFactory/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Nov 12, 2024 • 389 • 1

tensorblock/Llama3.1-8B-ShiningValiant2-GGUF

Text Generation • 8B • Updated Jan 27 • 22

Volko76/Qwen2.5-Coder-0.5B-Instruct-4.5bpw-exl2

Text Generation • Updated Nov 12, 2024

Volko76/Qwen2.5-Coder-0.5B-Instruct-1.0bpw-exl2

Text Generation • Updated Nov 12, 2024