Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,002

Base only

Active filters: chat

TitanML/Qwen2-7B-Instruct

Text Generation • 8B • Updated Sep 11, 2024 • 4

TitanML/Qwen2-7B-Instruct-AWQ

Text Generation • 8B • Updated Sep 11, 2024 • 4 • 1

TitanML/Qwen2-Math-7B

Text Generation • 8B • Updated Sep 11, 2024 • 6

TitanML/Qwen2-Math-7B-Instruct

Text Generation • 8B • Updated Sep 11, 2024 • 5

alpindale/Mistral-Large-Instruct-2407-FP8

Text Generation • 123B • Updated Sep 12, 2024 • 20 • 10

koesn/Llama3.1-8B-Fireplace2-GGUF

Text Generation • 8B • Updated Sep 12, 2024 • 35

ejiaf/qwen_math_int8_1.5B

Text Generation • 2B • Updated Sep 12, 2024 • 3

reddgr/gemma-2-2b-ft-lora-noticias-es

Updated Oct 11, 2024 • 1

andy0124/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 13, 2024 • 5

paultimothymooney/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Sep 13, 2024 • 2

TouchNight/gemma-2-27b-it-abliterated-Q3_K_M-GGUF

Text Generation • 27B • Updated Sep 13, 2024 • 34

byroneverson/Yi-1.5-34B-Chat-abliterated-gguf

Text Generation • 34B • Updated Sep 13, 2024 • 24 • 1

mradermacher/Qwen1.5-110B-Chat-GGUF

111B • Updated Mar 25, 2025 • 14 • 1

mradermacher/Yi-1.5-34B-Chat-abliterated-GGUF

34B • Updated Sep 15, 2024 • 290

mradermacher/Qwen1.5-110B-Chat-i1-GGUF

111B • Updated Sep 17, 2024 • 39

win10/internlm2_5-20b-chat-abliterated-Q6_K-GGUF

Text Generation • 20B • Updated Sep 15, 2024 • 13

mradermacher/Yi-1.5-34B-Chat-abliterated-i1-GGUF

34B • Updated Sep 15, 2024 • 794 • 3

cgus/magnum-v2.5-12b-kto-exl2

Text Generation • Updated Sep 15, 2024 • 6

mradermacher/calme-2.3-llama3.1-70b-GGUF

71B • Updated Sep 17, 2024 • 66

aashish1904/gemma-2-27b-it-abliterated-Q4_K_M-GGUF

Text Generation • 27B • Updated Sep 16, 2024 • 23 • 1

QuantFactory/gemma-2-27b-it-abliterated-GGUF

Text Generation • 27B • Updated Nov 6, 2024 • 2.14k • 7

TouchNight/gemma-2-27b-it-abliterated-Q2_K-GGUF

Text Generation • 27B • Updated Sep 16, 2024 • 5

TouchNight/gemma-2-27b-it-abliterated-Q3_K_S-GGUF

Text Generation • 27B • Updated Sep 16, 2024 • 11

Qwen/Qwen2.5-72B-Instruct

Text Generation • 73B • Updated Jan 12, 2025 • 667k • • 964

Qwen/Qwen2.5-Math-1.5B-Instruct

Text Generation • 2B • Updated Sep 23, 2024 • 465k • • 58

Qwen/Qwen2.5-Math-72B-Instruct

Text Generation • 73B • Updated Sep 23, 2024 • 2.78k • • 31

mradermacher/calme-2.3-qwen2-72b-GGUF

73B • Updated Sep 17, 2024 • 27

lmstudio-community/Qwen2.5-72B-Instruct-GGUF

Text Generation • 73B • Updated Sep 19, 2024 • 1.37k • 5

bartowski/Qwen2.5-72B-Instruct-GGUF

Text Generation • 73B • Updated Sep 19, 2024 • 105k • 44

mradermacher/calme-2.3-llama3.1-70b-i1-GGUF

71B • Updated Sep 17, 2024 • 152 • 2