Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,022

Base only

Active filters: chat

taobao-mnn/Yi-6B-Chat-MNN

Text Generation • Updated Dec 31, 2024 • 13

taobao-mnn/bge-large-zh-MNN

Text Generation • Updated Sep 27, 2024 • 13

taobao-mnn/chatglm-6b-MNN

Text Generation • Updated Sep 27, 2024 • 22

mukel/Qwen2.5-Math-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 27, 2024 • 34

taobao-mnn/chatglm2-6b-MNN

Text Generation • Updated Dec 31, 2024 • 24

taobao-mnn/chatglm3-6b-MNN

Text Generation • Updated Dec 31, 2024 • 16

taobao-mnn/codegeex2-6b-MNN

Text Generation • Updated Jan 2, 2025 • 16

taobao-mnn/deepseek-llm-7b-chat-MNN

Text Generation • Updated Dec 31, 2024 • 58 • 3

taobao-mnn/gemma-2-2b-it-MNN

Text Generation • Updated Dec 31, 2024 • 52

taobao-mnn/glm-4-9b-chat-MNN

Text Generation • Updated Dec 31, 2024 • 29

taobao-mnn/gte_sentence-embedding_multilingual-base-MNN

Text Generation • Updated Sep 27, 2024 • 23

taobao-mnn/internlm-chat-7b-MNN

Text Generation • Updated Jan 2, 2025 • 6 • 1

taobao-mnn/phi-2-MNN

Text Generation • Updated Dec 31, 2024 • 57 • 2

taobao-mnn/reader-lm-0.5b-MNN

Text Generation • Updated Dec 31, 2024 • 3

taobao-mnn/reader-lm-1.5b-MNN

Text Generation • Updated Dec 31, 2024 • 4

mradermacher/Josiefied-Qwen2.5-14B-Instruct-abliterated-v1-i1-GGUF

15B • Updated Oct 19, 2024 • 60 • 1

Kondara/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 27, 2024 • 28

pcuenq/Qwen2.5-0.5B-Instruct-with-new-merges-serialization

Text Generation • 0.5B • Updated Sep 27, 2024 • 44

mradermacher/Qwen2.5-72b-instruct-128k-i1-GGUF

73B • Updated Sep 28, 2024 • 86

anthracite-org/magnum-v4-72b-gguf

Text Generation • 73B • Updated Nov 25, 2024 • 754 • 12

jfiekdjdk/Qwen2.5-14B-Instruct-abliterated-4.0bpw-h6-exl2

Text Generation • Updated Sep 27, 2024 • 5

ValiantLabs/Llama3.2-3B-ShiningValiant2

Text Generation • 3B • Updated Jan 21, 2025 • 25 • • 6

anthracite-org/magnum-v4-9b-gguf

Text Generation • 9B • Updated Nov 25, 2024 • 526 • 18

Delta-Vector/Odin-9B

9B • Updated Dec 31, 2024 • 17 • 5

POWERHACK/Qwen2.5-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Sep 27, 2024 • 17

Goekdeniz-Guelmez/Josiefied-Qwen2.5-1.5B-Instruct-abliterated-v2

Text Generation • 2B • Updated Sep 28, 2024 • 25 • 1

pipilok/Qwen2.5-7B-Instruct-Q4_0_4_8-GGUF

Text Generation • 8B • Updated Sep 28, 2024 • 16

Goekdeniz-Guelmez/Josiefied-Qwen2.5-1.5B-Instruct-abliterated-v3

Text Generation • 2B • Updated Sep 28, 2024 • 29 • 2

pipilok/Qwen2.5-14B-Instruct-Q4_0_4_8-GGUF

Text Generation • 15B • Updated Sep 28, 2024 • 15

pipilok/Qwen2.5-1.5B-Instruct-Q4_0_4_8-GGUF

Text Generation • 2B • Updated Sep 28, 2024 • 92