Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,674

Base only

Active filters: chat

Minuano/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 10, 2024 • 7

MarsupialAI/MG-FinalMix-72B_iMatrix_GGUF

Text Generation • 73B • Updated Jul 10, 2024 • 85 • 1

grimjim/kalomaze_qwen2-7b-magpie300k_filtered_epoch2-GGUF

Text Generation • 8B • Updated Aug 25, 2024 • 21 • 1

arrio/Qwen2-1.5B-Instruct-Q4_K_S-GGUF

Text Generation • 2B • Updated Jul 11, 2024 • 7

martintomov/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 11, 2024 • 22

internlm/internlm2_5-7b-chat-1m-gguf

Text Generation • 8B • Updated Jul 11, 2024 • 88 • 4

Stark2008/Qwen1.5-14B-Chat-Q3_K_S-GGUF

Text Generation • 14B • Updated Jul 11, 2024 • 3

vahhab70/CodeQwen1.5-7B-Chat-Q4_K_M-GGUF

Text Generation • 7B • Updated Jul 11, 2024 • 6

Mezzaouia/Qwen2-0.5B-Instruct

Text Generation • Updated Jul 11, 2024 • 2

Stark2008/Qwen1.5-14B-Chat-Q3_K_M-GGUF

Text Generation • 14B • Updated Jul 11, 2024 • 6

Stark2008/Qwen1.5-14B-Chat-Q4_K_M-GGUF

Text Generation • 14B • Updated Jul 11, 2024 • 33

martintomov/Qwen1.5-14B-Chat-Q4_K_M-GGUF

Text Generation • 14B • Updated Jul 12, 2024 • 8

martintomov/Qwen1.5-32B-Chat-Q4_K_M-GGUF

Text Generation • 33B • Updated Jul 12, 2024 • 9

martintomov/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Jul 12, 2024 • 31

lordjia/Qwen2-Cantonese-7B-Instruct

Text Generation • Updated Aug 13, 2024 • 146 • • 4

mradermacher/Qwen2-Cantonese-7B-Instruct-GGUF

8B • Updated Jul 14, 2024 • 186

RESMPDEV/Qwen2-Wukong-7B

Text Generation • 8B • Updated Jul 14, 2024 • 7 • 3

Qwen/Qwen2-Audio-7B

Audio-Text-to-Text • 8B • Updated Nov 20, 2024 • 5.47k • 171

lordjia/Llama-3-Cantonese-8B-Instruct

Text Generation • Updated Aug 13, 2024 • 274 • • 8

sjster/test_v2_medium

Text Generation • 0.1B • Updated Mar 18, 2025 • 4

catbash/Mistral-7B-v0.1-flashback-v2-instruct-Q5_K_M-GGUF

Text Generation • 7B • Updated Jul 17, 2024 • 16 • 2

bartowski/Qwen2-Wukong-7B-GGUF

Text Generation • 8B • Updated Jul 17, 2024 • 540 • 1

bartowski/Qwen2-Wukong-7B-exl2

Text Generation • Updated Jul 17, 2024 • 2

billatsectorflow/Qwen2-72B-Instruct-GPTQ-Int4-128K

Text Generation • 73B • Updated Sep 25, 2024 • 3

bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 3

bigstorm/Qwen2-72B-Instruct-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 3

Suparious/Qwen2-7B-Instruct-v0.8-exl2-6.5bpw

Text Generation • Updated Jul 19, 2024 • 1

turboderp/turbcat-instruct-72b

Text Generation • 73B • Updated Jul 19, 2024 • 9 • • 31

turboderp/turbcat-instruct-72b-exl2

Text Generation • Updated Jul 19, 2024 • 2 • 6

mradermacher/Llama-3-Cantonese-8B-Instruct-GGUF

8B • Updated Jul 19, 2024 • 131