Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,665

Base only

Active filters: chatml

QuantFactory/Pantheon-RP-1.0-8b-Llama-3-GGUF

8B • Updated Aug 29, 2024 • 1k • 1

backyardai/Hermes-3-Llama-3.1-8B-GGUF

8B • Updated Aug 29, 2024 • 125 • 2

backyardai/Hermes-3-Llama-3.1-70B-GGUF

71B • Updated Aug 30, 2024 • 85 • 2

bartowski/Pantheon-RP-1.6-12b-Nemo-KTO-GGUF

Text Generation • 12B • Updated Aug 31, 2024 • 1.05k • 1

bartowski/Pantheon-RP-1.6-12b-Nemo-KTO-exl2

Text Generation • Updated Aug 31, 2024

bartowski/calme-2.2-qwen2-72b-GGUF

Text Generation • 73B • Updated Sep 1, 2024 • 1.43k

QuantFactory/Pantheon-RP-1.6-12b-Nemo-KTO-GGUF

12B • Updated Sep 3, 2024 • 305 • 2

Ffftdtd5dtft/Hermes-3-Llama-3.1-8B-IQ1_S-GGUF

8B • Updated Sep 4, 2024 • 16 • 1

jburmeister/Hermes-3-Llama-3.1-8B-GGUF

8B • Updated Sep 5, 2024 • 18 • 1

ktoprakucar/Hermes-3-Llama-3.1-8B-Q8-GPTQ

Updated Sep 5, 2024 • 20 • 2

koesn/Hermes-2-Theta-Llama-3-8B-32k-GGUF

8B • Updated Sep 6, 2024 • 31

koesn/Hermes-3-Llama-3.1-8B-GGUF

8B • Updated Sep 8, 2024 • 37

MaziyarPanahi/calme-2.2-llama3.1-70b

Text Generation • 71B • Updated Sep 29, 2024 • 15 • • 2

bartowski/Pantheon-RP-1.6.1-12b-Nemo-GGUF

Text Generation • 12B • Updated Sep 9, 2024 • 1.47k • 5

bartowski/Pantheon-RP-1.6.1-12b-Nemo-exl2

Text Generation • Updated Sep 9, 2024 • 5

async0x42/Pantheon-RP-1.6.1-12b-Nemo-exl2_8bpw

Updated Sep 9, 2024 • 2

MaziyarPanahi/calme-2.3-llama3.1-70b

Text Generation • 71B • Updated Sep 29, 2024 • 15 • • 3

mradermacher/calme-2.2-llama3.1-70b-GGUF

71B • Updated Sep 11, 2024 • 187

mradermacher/calme-2.2-llama3.1-70b-i1-GGUF

71B • Updated Sep 12, 2024 • 215

mradermacher/calme-2.3-llama3.1-70b-GGUF

71B • Updated Sep 17, 2024 • 107

mradermacher/calme-2.3-qwen2-72b-GGUF

73B • Updated Sep 17, 2024 • 89

mradermacher/calme-2.3-llama3.1-70b-i1-GGUF

71B • Updated Sep 17, 2024 • 417 • 2

mradermacher/calme-2.3-qwen2-72b-i1-GGUF

73B • Updated Sep 18, 2024 • 528

MaziyarPanahi/calme-2.2-qwen2.5-72b

Text Generation • 73B • Updated Sep 29, 2024 • 43 • • 6

MaziyarPanahi/calme-2.1-qwen2.5-72b

Text Generation • 73B • Updated Sep 20, 2024 • 49 • • 5

QuantFactory/Llama3-OpenBioLLM-8B-GGUF

8B • Updated Sep 22, 2024 • 166 • 1

WSDW/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

8B • Updated Sep 23, 2024 • 26

dfurman/CalmeRys-78B-Orpo-v0.1

Text Generation • 78B • Updated Oct 20, 2024 • 28 • 78

mradermacher/CalmeRys-78B-Orpo-v0.1-GGUF

78B • Updated Dec 13, 2024 • 161 • 1

mradermacher/CalmeRys-78B-Orpo-v0.1-i1-GGUF

78B • Updated Sep 28, 2024 • 986 • 1