Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,210

Base only

Active filters: chat

RedHatAI/Llama-2-7b-ultrachat200k-pruned_50

Text Generation • 7B • Updated May 15, 2024 • 13

RedHatAI/Llama-2-7b-ultrachat200k-pruned_70

Text Generation • 7B • Updated May 15, 2024 • 13

RedHatAI/Llama-2-7b-ultrachat200k-pruned_50-quantized-deepsparse

Text Generation • Updated May 7, 2024 • 4

RedHatAI/Llama-2-7b-ultrachat200k-pruned_70-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 10

yam-peleg/gemma-7b-experiment

Text Generation • 9B • Updated Mar 16, 2024 • 52

yam-peleg/gemma-7b-it-experiment

Text Generation • 9B • Updated Mar 16, 2024 • 51

MarsupialAI/KitchenSink_103b_iMatrix_GGUF

103B • Updated May 11, 2024 • 19 • 1

DisOOM/Yi-70B-200k-RPMerge-Franken

Text Generation • 71B • Updated Mar 21, 2024 • 3 • 1

bartowski/Qwen1.5-7B-Chat-GGUF

Text Generation • 8B • Updated Mar 19, 2024 • 137

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • 14B • Updated Jun 9, 2024 • 1.98k • 50

MarsupialAI/LaDameBlanche-103b

Text Generation • 103B • Updated Mar 23, 2024 • 2 • 3

Ionio-ai/ZeproSolar-2x7B

Text Generation • 13B • Updated Apr 2, 2024 • 6

botp/Liberated-Qwen1.5-72B-GGUF

Text Generation • Updated Mar 29, 2024

robinsmits/Qwen1.5-7B-Dutch-Chat-GGUF

Text Generation • 8B • Updated Mar 30, 2024 • 64 • 1

MarsupialAI/LaDameBlanche-v2-95b

Text Generation • 95B • Updated Apr 22, 2024 • 17 • 12

mradermacher/Melusine_103b-GGUF

103B • Updated May 6, 2024 • 27 • 1

mradermacher/LaDameBlanche-103b-GGUF

103B • Updated May 6, 2024 • 35 • 3

mradermacher/Melusine_103b-i1-GGUF

103B • Updated May 6, 2024 • 32 • 1

mradermacher/KitchenSink_103b-GGUF

103B • Updated May 6, 2024 • 33 • 1

mradermacher/KitchenSink_103b-i1-GGUF

103B • Updated May 6, 2024 • 92 • 1

mradermacher/LaDameBlanche-103b-i1-GGUF

103B • Updated May 6, 2024 • 68 • 2

Qwen/Qwen1.5-32B-Chat-GPTQ-Int4

Text Generation • 33B • Updated Apr 30, 2024 • 6.96k • 31

mradermacher/LaDameBlanche-v2-95b-GGUF

95B • Updated May 6, 2024 • 4 • 2

nazlicanto/phi-2-persona-chat

Text Generation • 3B • Updated Apr 2, 2024 • 22 • 5

mradermacher/LaDameBlanche-v2-95b-i1-GGUF

95B • Updated Feb 5, 2025 • 102 • 2

arlineka/KittyNyanster-v1

Text Generation • 7B • Updated Apr 4, 2024 • 50 • 4

mradermacher/KittyNyanster-v1-GGUF

7B • Updated May 6, 2024 • 218 • 2

Qwen/Qwen1.5-32B-Chat

Text Generation • 33B • Updated Apr 30, 2024 • 12k • 108

Qwen/Qwen1.5-32B-Chat-GGUF

Text Generation • 33B • Updated Apr 9, 2024 • 334 • 52

mradermacher/CatNyanster-34b-GGUF

34B • Updated May 6, 2024 • 182 • 1