Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

68

Base only

Active filters: Llama-3.1

NousResearch/Hermes-4-70B

Text Generation • 71B • Updated Sep 2, 2025 • 813 • • 192

NousResearch/Hermes-4-70B-FP8

Text Generation • 71B • Updated Sep 12, 2025 • 47.4k • 32

NousResearch/Hermes-4-405B

Text Generation • 406B • Updated Sep 2, 2025 • 431 • • 91

NousResearch/Hermes-4-405B-FP8

Text Generation • 406B • Updated Sep 2, 2025 • 426 • 31

mlx-community/Hermes-4-70B-5bit

Text Generation • 71B • Updated Aug 26, 2025 • 49 • 2

cyankiwi/Hermes-4-70B-AWQ-4bit

Text Generation • 13B • Updated Aug 27, 2025 • 64.3k • 7

SentientAGI/Dobby-Mini-Leashed-Llama-3.1-8B

Text Generation • 8B • Updated Feb 12, 2025 • 23 • • 12

SentientAGI/Dobby-Mini-Unhinged-Llama-3.1-8B

Text Generation • 8B • Updated Feb 12, 2025 • 66 • • 48

SentientAGI/Dobby-Mini-Leashed-Llama-3.1-8B_GGUF

8B • Updated Jan 24, 2025 • 36 • 4

SentientAGI/Dobby-Mini-Unhinged-Llama-3.1-8B_GGUF

8B • Updated Jan 24, 2025 • 86 • 6

mradermacher/Dobby-Mini-Leashed-Llama-3.1-8B-GGUF

8B • Updated Mar 29, 2025 • 181 • 2

mradermacher/Dobby-Mini-Leashed-Llama-3.1-8B-i1-GGUF

8B • Updated Feb 5, 2025 • 346 • 1

mradermacher/Dobby-Mini-Unhinged-Llama-3.1-8B-GGUF

8B • Updated Feb 5, 2025 • 646 • 1

mradermacher/Dobby-Mini-Unhinged-Llama-3.1-8B-i1-GGUF

8B • Updated Feb 5, 2025 • 529 • 1

tensorblock/Dobby-Mini-Unhinged-Llama-3.1-8B-GGUF

8B • Updated Jan 27 • 71

tensorblock/Dobby-Mini-Leashed-Llama-3.1-8B-GGUF

8B • Updated Jan 27 • 51

matrixportalx/Dobby-Mini-Leashed-Llama-3.1-8B-GGUF

8B • Updated Feb 18, 2025 • 46

matrixportalx/Dobby-Mini-Unhinged-Llama-3.1-8B-GGUF

8B • Updated Feb 18, 2025 • 22

mradermacher/L3.1-4x8b_BlackTower_RP-V1.1-Uncensored-GGUF

25B • Updated Jul 31, 2025 • 32 • 2

mradermacher/L3.1-4x8b_BlackTower_RP-V1.1-Uncensored-i1-GGUF

25B • Updated Feb 23, 2025 • 231 • 1

SentientAGI/Dobby-Mini-Unhinged-Plus-Llama-3.1-8B

Text Generation • 8B • Updated Jun 4, 2025 • 15 • • 18

SentientAGI/Dobby-Mini-Unhinged-Plus-Llama-3.1-8B_GGUF

8B • Updated May 16, 2025 • 23

lianghsun/Llama-3.1-DeepFox-70B-Instruct

Text Generation • Updated 27 days ago

mlx-community/Dobby-Mini-Unhinged-Plus-Llama-3.1-8B-bf16

Text Generation • 8B • Updated Jun 11, 2025 • 7

mlx-community/Dobby-Mini-Unhinged-Plus-Llama-3.1-8B-4bit

Text Generation • 1B • Updated Jun 11, 2025 • 6

mlx-community/Dobby-Mini-Unhinged-Plus-Llama-3.1-8B-8bit

Text Generation • 8B • Updated Jun 11, 2025 • 7

lmstudio-community/Hermes-4-405B-MLX-5bit

Text Generation • 406B • Updated Aug 26, 2025 • 321

lmstudio-community/Hermes-4-405B-MLX-4bit

Text Generation • 406B • Updated Aug 26, 2025 • 794 • 1

lmstudio-community/Hermes-4-405B-MLX-6bit

Text Generation • 406B • Updated Aug 26, 2025 • 333

lmstudio-community/Hermes-4-405B-MLX-8bit

Text Generation • 406B • Updated Aug 26, 2025 • 553 • 1