Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

3,998

Base only

Active filters: instruct

defenseunicorns/Hermes-2-Pro-Mistral-7B-4bit-32g-GPTQ

Text Generation • 7B • Updated Aug 2, 2024 • 20

bartowski/Palmyra-Fin-70B-32K-GGUF

Text Generation • 71B • Updated Aug 5, 2024 • 12.1k • 5

mlx-community/Writer-Palmyra-Fin-70B-32K

71B • Updated Aug 4, 2024 • 74 • 3

mradermacher/Meta-Llama-3.1-8B-openhermes-2.5-GGUF

8B • Updated Aug 4, 2024 • 1.29k

Pterko/llama-3-12b-instruct-Q8_0-GGUF

Text Generation • 12B • Updated Aug 4, 2024 • 17

mradermacher/Pantheon-RP-1.5-12b-Nemo-GGUF

12B • Updated Aug 4, 2024 • 158 • 3

mradermacher/Pantheon-RP-1.5-12b-Nemo-i1-GGUF

12B • Updated Aug 4, 2024 • 158 • 1

Ransss/Pantheon-RP-1.5-12b-Nemo-Q8_0-GGUF

12B • Updated Aug 4, 2024 • 9 • 1

bartowski/Pantheon-RP-1.5-12b-Nemo-GGUF

Text Generation • 12B • Updated Aug 5, 2024 • 1.41k • 3

bartowski/Pantheon-RP-1.5-12b-Nemo-exl2

Text Generation • Updated Aug 4, 2024 • 18

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

71B • Updated Aug 23, 2024 • 1.66k • 54

ValiantLabs/Llama3.1-8B-ShiningValiant2

Text Generation • 8B • Updated Mar 12, 2025 • 111 • • 17

monsterapi/gemma-2-2b-hindi-translator

Translation • Updated Aug 7, 2024 • 15 • 1

NousResearch/Hermes-3-Llama-3.1-70B-FP8

71B • Updated Sep 8, 2024 • 113k • 28

QuantFactory/Pantheon-RP-1.5-12b-Nemo-GGUF

12B • Updated Aug 7, 2024 • 661 • 5

ModelCloud/EXAONE-3.0-7.8B-Instruct-gptq-4bit

8B • Updated Aug 9, 2024 • 17 • 3

GPT4All-Community/Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Aug 20, 2024 • 163 • 1

ValiantLabs/Llama3.1-8B-Enigma

Text Generation • 8B • Updated Mar 12, 2025 • 72 • 10

zelias/BgGPT-7B-Instruct-v0.2_exl2_8bpw

Text Generation • Updated Aug 11, 2024 • 20

UCLA-EMC/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-32-2.17B

Text Generation • 8B • Updated Aug 30, 2024 • 28 • 1

NousResearch/Hermes-3-Llama-3.1-405B-FP8

406B • Updated Sep 9, 2024 • 168 • 29

NousResearch/Hermes-3-Llama-3.1-405B

Text Generation • 406B • Updated Oct 8, 2024 • 1.25k • • 275

skratos115/LLAMA_3.1_8B_OpenDevin_DEVINator

Text Generation • 8B • Updated Aug 13, 2024 • 99 • 3

Rybens/Hermes-3-Llama-3.1-8B-Q3_K_S-GGUF

8B • Updated Aug 15, 2024 • 81 • 1

YorkieOH10/Hermes-3-Llama-3.1-8B-Q8_0-GGUF

8B • Updated Aug 15, 2024 • 75 • 1

bartowski/Hermes-3-Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Aug 16, 2024 • 12.1k • 22

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 8 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 8 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 8 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 8 • 2