Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,670

Base only

Active filters: chat

typhoon-ai/llama-3-typhoon-v1.5-8b-instruct

Text Generation • 8B • Updated Mar 31, 2025 • 9.58k • • 30

noxinc/Mistral-portuguese-luana-7b-chat-Q5_K_M-GGUF-PTBR

Text Generation • 7B • Updated May 7, 2024 • 16

YorkieOH10/CodeQwen1.5-7B-Chat-Q8_0-GGUF

Text Generation • 7B • Updated May 7, 2024 • 7

mlx-community/typhoon-v1.5-8b-instruct-4bit-mlx

Text Generation • Updated May 9, 2024 • 32

second-state/Qwen1.5-110B-Chat-GGUF

Text Generation • 111B • Updated May 26, 2024 • 198 • 2

kpkiosk66/llama-3-typhoon-v1.5-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated May 9, 2024 • 6 • 1

ValiantLabs/Llama3-70B-Fireplace

Text Generation • 71B • Updated Mar 12, 2025 • 8.36k • • 3

mradermacher/Qwen1.5-32B-Chat-GGUF

33B • Updated May 10, 2024 • 190

Anthonyg5005/Qwen1.5-0.5B-Chat-exl2

Text Generation • Updated Mar 22, 2025 • 16

mradermacher/Qwen1.5-72B-Chat-GGUF

72B • Updated May 11, 2024 • 91

REILX/Llama-3-8B-Instruct-750Mb-lora

Updated Jun 18, 2024

mradermacher/Qwen1.5-72B-Chat-i1-GGUF

72B • Updated May 14, 2024 • 189

lordjia/wawj-7b-chat-gguf

Text Generation • Updated Jun 14, 2024 • 29 • 2

lordjia/wawj-14b-chat-gguf

Text Generation • Updated Jun 14, 2024 • 9 • 1

Bluckr/Phi-3-mini-4k-instruct-function-calling-assistant-spanish-pofi-v2

Text Generation • 4B • Updated May 17, 2024 • 6

pearpresha/CodeQwen1.5-7B-Chat-Llamafied

Text Generation • 7B • Updated May 13, 2024

apresence/llama-3-typhoon-v1.5-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated May 13, 2024 • 5

CISCai/Nxcode-CQ-7B-orpo-SOTA-GGUF

Text Generation • 7B • Updated May 14, 2024 • 202

Ayush-1722/Mistral-7B-Instruct-v0.1-Summarize-64K-LoRANET-Merged

Text Generation • 7B • Updated Jun 19, 2024 • 2

Ayush-1722/Meta-Llama-3-8B-Instruct-Summarize-v0.2-16K-LoRANET-Merged

Text Generation • 8B • Updated Jun 19, 2024 • 6 • 2

lordjia/wawj-1.8b-chat-gguf

Text Generation • Updated May 17, 2024 • 4 • 2

BICENG/CodeQwen1.5-7B-Chat-Q4_K_M-GGUF

Text Generation • 7B • Updated May 15, 2024 • 20

sail/Sailor-14B-Chat

Text Generation • 14B • Updated Dec 21, 2024 • 21 • 11

sail/Sailor-14B-Chat-gguf

14B • Updated Dec 21, 2024 • 115 • 5

zai-org/cogvlm2-llama3-chat-19B

Text Generation • 20B • Updated Sep 3, 2024 • 6.43k • 220

zai-org/cogvlm2-llama3-chinese-chat-19B

Text Generation • 20B • Updated Sep 11, 2024 • 77 • 68

noxinc/Mistral-portuguese-luana-7b-chat-Q8_0-GGUF-PTBR

Text Generation • 7B • Updated May 16, 2024 • 4

mradermacher/Sailor-14B-Chat-GGUF

14B • Updated May 17, 2024 • 324

afrideva/Phi-3-mini-4k-instruct-function-calling-assistant-spanish-pofi-v2-GGUF

Text Generation • 4B • Updated May 18, 2024 • 175 • 2

NikolayKozloff/llama-3-typhoon-v1.5-8b-instruct-Q6_K-GGUF

Text Generation • 8B • Updated May 20, 2024 • 27 • 1