Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,665

Base only

Active filters: chatml

genevera/Medical-Llama3-8B-Q5_K_M-GGUF

8B • Updated Jul 30, 2024 • 10

genevera/Medical-Llama3-8B-Q6_K-GGUF

8B • Updated Jul 30, 2024 • 10

mradermacher/calme-2.2-qwen2-72b-GGUF

73B • Updated Sep 8, 2024 • 454

mradermacher/calme-2.2-qwen2-72b-i1-GGUF

73B • Updated Sep 8, 2024 • 227

justinthelaw/Hermes-2-Pro-Mistral-7B-4bit-32g-GPTQ

Text Generation • 7B • Updated Aug 2, 2024 • 5 • 1

defenseunicorns/Hermes-2-Pro-Mistral-7B-4bit-32g-GPTQ

Text Generation • 7B • Updated Aug 2, 2024 • 2

mradermacher/Meta-Llama-3.1-8B-openhermes-2.5-GGUF

8B • Updated Aug 4, 2024 • 107

mradermacher/Pantheon-RP-1.5-12b-Nemo-GGUF

12B • Updated Aug 4, 2024 • 105 • 3

mradermacher/Pantheon-RP-1.5-12b-Nemo-i1-GGUF

12B • Updated Aug 4, 2024 • 93 • 1

Ransss/Pantheon-RP-1.5-12b-Nemo-Q8_0-GGUF

12B • Updated Aug 4, 2024 • 6 • 1

bartowski/Pantheon-RP-1.5-12b-Nemo-GGUF

Text Generation • 12B • Updated Aug 5, 2024 • 5.77k • 3

bartowski/Pantheon-RP-1.5-12b-Nemo-exl2

Text Generation • Updated Aug 4, 2024

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

71B • Updated Aug 23, 2024 • 4.3k • 48

MaziyarPanahi/calme-2.3-qwen2-72b

Text Generation • 73B • Updated Sep 29, 2024 • 36 • 2

NousResearch/Hermes-3-Llama-3.1-70B-FP8

71B • Updated Sep 8, 2024 • 13k • 26

MaziyarPanahi/calme-2.3-rys-78b

Text Generation • 78B • Updated Aug 7, 2024 • 36 • 4

MaziyarPanahi/calme-2.1-rys-78b

Text Generation • 78B • Updated Sep 17, 2024 • 45 • 3

MaziyarPanahi/calme-2.2-rys-78b

Text Generation • 78B • Updated Aug 7, 2024 • 29 • 3

QuantFactory/Pantheon-RP-1.5-12b-Nemo-GGUF

12B • Updated Aug 7, 2024 • 354 • 4

MaziyarPanahi/calme-2.4-rys-78b

Text Generation • 78B • Updated Sep 11, 2024 • 45 • 48

mradermacher/calme-2.2-rys-78b-GGUF

78B • Updated Aug 8, 2024 • 63

mradermacher/calme-2.1-rys-78b-GGUF

78B • Updated Aug 8, 2024 • 47

mradermacher/calme-2.2-rys-78b-i1-GGUF

78B • Updated Mar 31, 2025 • 118

mradermacher/calme-2.1-rys-78b-i1-GGUF

78B • Updated Aug 8, 2024 • 634 • 1

GPT4All-Community/DiscoLM_German_7b_v1-GGUF

Text Generation • 7B • Updated Aug 13, 2024 • 136

bartowski/calme-2.3-rys-78b-GGUF

Text Generation • 78B • Updated Aug 13, 2024 • 951 • 2

mradermacher/calme-2.4-rys-78b-GGUF

78B • Updated Sep 16, 2024 • 229 • 7

NousResearch/Hermes-3-Llama-3.1-405B-FP8

406B • Updated Sep 9, 2024 • 49 • 29

NousResearch/Hermes-3-Llama-3.1-405B

Text Generation • 406B • Updated Oct 8, 2024 • 1.01k • 268

mradermacher/calme-2.4-rys-78b-i1-GGUF

78B • Updated Sep 16, 2024 • 131 • 2