Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,669

Base only

Active filters: chat

madroid/Qwen1.5-0.5B

Text Generation • 0.6B • Updated Mar 5, 2024 • 120 •

mradermacher/chronos007-70b-i1-GGUF

69B • Updated May 10, 2024 • 380 • 1

DisOOM/Qwen1.5-124B-Chat-Merge

Text Generation • 125B • Updated Mar 9, 2024 • 7 • 2

mradermacher/chronos-70b-v2-i1-GGUF

69B • Updated May 10, 2024 • 326 • 1

glacio-dev/Qwen1.5-7B-Chat-Q4

Text Generation • 2B • Updated Mar 6, 2024 • 30

glacio-dev/Qwen1.5-14B-Chat-Q4

Text Generation • 2B • Updated Mar 6, 2024 • 38

Noeda/Liberated-Qwen1.5-72B-GGUF

Text Generation • Updated Mar 7, 2024 • 2

madroid/qwen1.5-0.5B-4bit-flow

Text Generation • 0.2B • Updated Mar 7, 2024 • 30

mlx-community/Qwen1.5-4B-Chat-4bit

Text Generation • Updated Mar 7, 2024 • 43

mlx-community/Qwen1.5-7B-Chat-4bit

Text Generation • Updated Mar 7, 2024 • 61 • 2

mlx-community/Qwen1.5-14B-Chat-4bit

Text Generation • Updated Mar 8, 2024 • 49 • 1

mlx-community/Qwen1.5-72B-Chat-4bit

Text Generation • Updated Mar 8, 2024 • 42 • 2

madroid/qwen1.5-0.5B-4bit-new

Text Generation • 0.2B • Updated Mar 8, 2024 • 29

shapermindai/code-gemma-7b

Text Generation • Updated Mar 8, 2024 • 2

DisOOM/Qwen1.5-22B-Chat-Merge

Text Generation • 22B • Updated Mar 17, 2024 • 1

danilopeixoto/pandora-7b-chat

Text Generation • Updated Mar 24, 2024 • 1

DisOOM/Qwen1.5-55B-Chat-Cut

Text Generation • 55B • Updated Mar 16, 2024 • 4

DisOOM/Qwen1.5-120B-Chat-Merge-v2

Updated Mar 13, 2024

Qwen/Qwen1.5-MoE-A2.7B-Chat

Text Generation • 14B • Updated Apr 30, 2024 • 64.3k • 134

RedHatAI/Llama-2-7b-ultrachat200k

Text Generation • 7B • Updated May 7, 2024 • 12 • • 1

RedHatAI/Llama-2-7b-ultrachat200k-pruned_50

Text Generation • 7B • Updated May 15, 2024 • 6

RedHatAI/Llama-2-7b-ultrachat200k-pruned_70

Text Generation • 7B • Updated May 15, 2024 • 7

RedHatAI/Llama-2-7b-ultrachat200k-pruned_50-quantized-deepsparse

Text Generation • Updated May 7, 2024 • 7

RedHatAI/Llama-2-7b-ultrachat200k-pruned_70-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 5

yam-peleg/gemma-7b-experiment

Text Generation • 9B • Updated Mar 16, 2024 • 79

yam-peleg/gemma-7b-it-experiment

Text Generation • 9B • Updated Mar 16, 2024 • 77

MarsupialAI/KitchenSink_103b_iMatrix_GGUF

103B • Updated May 11, 2024 • 6 • 1

DisOOM/Yi-70B-200k-RPMerge-Franken

Text Generation • 71B • Updated Mar 21, 2024 • 6 • 1

bartowski/Qwen1.5-7B-Chat-GGUF

Text Generation • 8B • Updated Mar 19, 2024 • 98

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • 14B • Updated Jun 9, 2024 • 2.26k • 50