Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,212

Base only

Active filters: chat

MaziyarPanahi/calme-2.2-qwen2-72b

Text Generation • 73B • Updated Sep 15, 2024 • 16 • • 5

Minuano/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 10, 2024 • 5

MarsupialAI/MG-FinalMix-72B_iMatrix_GGUF

Text Generation • 73B • Updated Jul 10, 2024 • 290 • 1

grimjim/kalomaze_qwen2-7b-magpie300k_filtered_epoch2-GGUF

Text Generation • 8B • Updated Aug 25, 2024 • 23 • 1

arrio/Qwen2-1.5B-Instruct-Q4_K_S-GGUF

Text Generation • 2B • Updated Jul 11, 2024 • 23

martintomov/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 11, 2024 • 15

internlm/internlm2_5-7b-chat-1m-gguf

Text Generation • 8B • Updated Jul 11, 2024 • 182 • 4

Stark2008/Qwen1.5-14B-Chat-Q3_K_S-GGUF

Text Generation • 14B • Updated Jul 11, 2024 • 16

vahhab70/CodeQwen1.5-7B-Chat-Q4_K_M-GGUF

Text Generation • 7B • Updated Jul 11, 2024 • 10

Mezzaouia/Qwen2-0.5B-Instruct

Text Generation • Updated Jul 11, 2024 • 7

Stark2008/Qwen1.5-14B-Chat-Q3_K_M-GGUF

Text Generation • 14B • Updated Jul 11, 2024 • 10

Stark2008/Qwen1.5-14B-Chat-Q4_K_M-GGUF

Text Generation • 14B • Updated Jul 11, 2024 • 10

martintomov/Qwen1.5-14B-Chat-Q4_K_M-GGUF

Text Generation • 14B • Updated Jul 12, 2024 • 11

martintomov/Qwen1.5-32B-Chat-Q4_K_M-GGUF

Text Generation • 33B • Updated Jul 12, 2024 • 6

martintomov/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Jul 12, 2024 • 34

lordjia/Qwen2-Cantonese-7B-Instruct

Text Generation • 8B • Updated Aug 13, 2024 • 125 • • 4

mradermacher/Qwen2-Cantonese-7B-Instruct-GGUF

8B • Updated Jul 14, 2024 • 361 • 1

RESMPDEV/Qwen2-Wukong-7B

Text Generation • 8B • Updated Jul 14, 2024 • 4 • 3

lordjia/Llama-3-Cantonese-8B-Instruct

Text Generation • 8B • Updated Aug 13, 2024 • 111 • • 8

sjster/test_v2_medium

Text Generation • 0.1B • Updated Mar 18, 2025 • 5

catbash/Mistral-7B-v0.1-flashback-v2-instruct-Q5_K_M-GGUF

Text Generation • 7B • Updated Jul 17, 2024 • 15 • 2

bartowski/Qwen2-Wukong-7B-GGUF

Text Generation • 8B • Updated Jul 17, 2024 • 1.04k • 1

bartowski/Qwen2-Wukong-7B-exl2

Text Generation • Updated Jul 17, 2024 • 2

billatsectorflow/Qwen2-72B-Instruct-GPTQ-Int4-128K

Text Generation • 73B • Updated Sep 25, 2024 • 5

bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 4

bigstorm/Qwen2-72B-Instruct-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 4

Suparious/Qwen2-7B-Instruct-v0.8-exl2-6.5bpw

Text Generation • Updated Jul 19, 2024 • 7

turboderp/turbcat-instruct-72b

Text Generation • 73B • Updated Jul 19, 2024 • 10 • • 31

turboderp/turbcat-instruct-72b-exl2

Text Generation • Updated Jul 19, 2024 • 3 • 6

mradermacher/Llama-3-Cantonese-8B-Instruct-GGUF

8B • Updated Jul 19, 2024 • 447