Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,024

Base only

Active filters: chat

anthracite-org/magnum-v4-123b-exl2

Text Generation • Updated Nov 25, 2024 • 6 • 6

mit-han-lab/Qwen2-VL-1.5B-Instruct

Text Generation • 2B • Updated Oct 13, 2024 • 28 • 1

Erlanggaa/qwen1.5b

Text Generation • 2B • Updated Oct 13, 2024 • 2

Rubavijayan/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Oct 13, 2024 • 7

mradermacher/Odin-9B-GGUF

9B • Updated Dec 31, 2024 • 139 • 1

mradermacher/Odin-9B-i1-GGUF

9B • Updated Oct 20, 2024 • 222 • 1

adamo1139/Hermes-3-Llama-3.1-8B-Static-FP8-KV

8B • Updated Oct 19, 2024 • 3

adamo1139/Hermes-3-Llama-3.1-8B-Dynamic-FP8-KV

8B • Updated Oct 19, 2024

APHRA76/2.5-72B-Instruct

Text Classification • Updated Oct 14, 2024

QuantFactory/Baldur-8B-GGUF

8B • Updated Oct 14, 2024 • 253 • 4

evolveon/Mistral-7B-Instruct-v0.3-abliterated

Text Generation • 7B • Updated Oct 14, 2024 • 718 • • 2

cksghl1004/Qwen2.5-32B-Instruct-AWQ

Text Generation • 33B • Updated Oct 14, 2024 • 5

QuantFactory/Darkens-8B-GGUF

8B • Updated Oct 14, 2024 • 334 • 2

QuantFactory/Tor-8B-GGUF

8B • Updated Oct 14, 2024 • 349 • 2

QuantFactory/Odin-9B-GGUF

9B • Updated Oct 14, 2024 • 117 • 3

nick911/hermes-3-llama-3-1-405b-fp8

406B • Updated Oct 14, 2024 • 1

Jellon/Qwen2.5-14B-Instruct-abliterated-v2-6bpw

Text Generation • Updated Apr 28, 2025 • 14

apto-as/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 14, 2024 • 40

mlx-community/magnum-v2-72b

Text Generation • Updated Oct 14, 2024 • 41

ApprikatAI/Qwen2.5-Coder-1.5B-Instruct-FP16-GGUF

Text Generation • 2B • Updated Oct 14, 2024 • 59

sheldonrobinson/Qwen2.5-Math-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 14, 2024 • 27

sheldonrobinson/Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Oct 14, 2024 • 111

mPLUG/mPLUG-Owl3-2B-241014

Visual Question Answering • 2B • Updated Oct 15, 2024 • 36 • 6

mPLUG/mPLUG-Owl3-1B-241014

Visual Question Answering • 0.9B • Updated Oct 15, 2024 • 11 • 2

nick911/hermes-3-llama-3-1-405B

Text Generation • 406B • Updated Oct 15, 2024 • 4

Junrui2021/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 15, 2024 • 13

philipp-zettl/Qwen2-1.5B-Instruct

Text Generation • 2B • Updated Oct 15, 2024 • 3

nick911/hermes-3-llama-3-1-8B

8B • Updated Oct 15, 2024 • 1

noxinc/Qwen2.5-32B-Instruct-Q5_K_M-GGUF

Text Generation • 33B • Updated Oct 15, 2024 • 13

ElMater06/Llama-3.2-1B-Puredove-p

Text Generation • 1B • Updated Oct 18, 2024 • 24 • • 1