Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,022

Base only

Active filters: chat

justatom/Qwen2.5-14B-Instruct-bf16-Q8_0-GGUF

Text Generation • 15B • Updated Oct 25, 2024 • 20 • 1

ysn-rfd/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Oct 25, 2024 • 20 • 1

ysn-rfd/Qwen2.5-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Oct 25, 2024 • 8

ysn-rfd/Qwen2.5-1.5B-Instruct-Q8_0-GGUF

Text Generation • 2B • Updated Oct 25, 2024 • 164 • 1

Delta-Vector/Control-8B-EXL2

Updated Dec 31, 2024 • 1

bartowski/Monstral-123B-GGUF

Text Generation • 123B • Updated Oct 26, 2024 • 514 • 2

bartowski/Dracarys2-72B-Instruct-GGUF

Text Generation • Updated Oct 26, 2024 • 68

Manel/Llama-2-7b-chat-hf-Q3_K_M-GGUF

7B • Updated Nov 3, 2024 • 11

marroyo777/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Oct 26, 2024 • 46

marroyo777/Qwen2.5-1.5B-Instruct-Q2_K-GGUF

Text Generation • 2B • Updated Oct 26, 2024 • 52

QuantFactory/Control-8B-GGUF

8B • Updated Oct 26, 2024 • 18 • 2

mradermacher/Control-8B-GGUF

8B • Updated Aug 1, 2025 • 35

mradermacher/Control-8B-i1-GGUF

8B • Updated Oct 26, 2024 • 79

Manel/Llama-2-7b-chat-hf-Q2_K-GGUF

Text Generation • 7B • Updated Nov 3, 2024 • 5

SzilviaB/Pervepsion-12B-x1-Q8_0-GGUF

12B • Updated Oct 26, 2024 • 2 • 1

Manel/Llama-2-13b-chat-hf-Q4_K_M-GGUF

Text Generation • 13B • Updated Nov 3, 2024 • 2

c01zaut/Qwen2.5-7B-Instruct-rk3588-v1.1.0

Text Generation • Updated Oct 28, 2024 • 18

Manel/Llama-2-13b-chat-hf-Q4_0-GGUF

Text Generation • 13B • Updated Nov 3, 2024 • 8

zetasepic/Qwen2.5-72B-Instruct-abliterated-v2

Text Generation • 73B • Updated Oct 28, 2024 • 71 • • 5

zetasepic/Qwen2.5-72B-Instruct-abliterated-v2-GGUF

Text Generation • 73B • Updated Oct 28, 2024 • 2.22k • 4

ParasiticRogue/EVA-Instruct-32B-exl2-4.0

Text Generation • Updated Oct 30, 2024 • 3 • 3

marroyo777/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Oct 28, 2024 • 22

compressa-ai/Compressa-Qwen2.5-14B-Instruct

Text Generation • 15B • Updated Oct 28, 2024 • 4 • 1

hkshawn/72b

Text Generation • 73B • Updated Oct 28, 2024 • 4

ParasiticRogue/EVA-Instruct-32B

Text Generation • 33B • Updated Oct 30, 2024 • 3 • 6

tadangkhoa1999/Qwen2.5-14B-Instruct-AWQ-trim-vocab

Text Generation • 14B • Updated Oct 30, 2024 • 5

hkshawn/14b

Text Generation • 15B • Updated Oct 30, 2024 • 3

bartowski/shuttle-3-GGUF

Text Generation • 73B • Updated Oct 29, 2024 • 74

Aarushhh/yuno-225M-python-it

Text Generation • 0.2B • Updated Oct 29, 2024 • 1

Delta-Vector/Control-8B-V1.1

8B • Updated Jan 3, 2025 • 2 • 1