Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,665

Base only

Active filters: chatml

mradermacher/EtherealAurora-12B-Lorablated-i1-GGUF

12B • Updated Dec 25, 2025 • 150 • 2

yamatazen/DellaMix-12B

Text Generation • 12B • Updated Aug 2, 2025 • 8 • • 6

mradermacher/DellaMix-12B-GGUF

12B • Updated Aug 2, 2025 • 38 • 2

mradermacher/DellaMix-12B-i1-GGUF

12B • Updated Dec 24, 2025 • 215 • 2

huehui/Discord-Micae-Hermes-3-3B-abliterated

Text Generation • 3B • Updated Aug 3, 2025 • 10 • 4

sik247/lexpt

Text Generation • Updated Aug 15, 2025 • 2

xumingtensor/affine-161803699

Text Generation • 24B • Updated Aug 17, 2025 • 3

Lewdiculous/CaptainErisNebula-12B-AOE-v1-GGUF-IQ-Imatrix

12B • Updated Aug 27, 2025 • 94 • 5

aaronmoo12/Discord-Micae-8B-Preview

Text Generation • 8B • Updated Aug 18, 2025 • 4

aaronmoo12/Discord-Micae-Hermes-3-3B

Text Generation • 3B • Updated Aug 19, 2025 • 14 • 3

tensorblock/mookiezi_Discord-Micae-Hermes-3-3B-GGUF

Text Generation • 3B • Updated Jan 27 • 40 • 2

Lewdiculous/CaptainErisNebula-12B-Chimera-v1.1-GGUF-IQ-Imatrix

12B • Updated Aug 31, 2025 • 1.45k • 23

mookiezii/Discord-Hermes-3-8B

Text Generation • 8B • Updated Aug 25, 2025 • 872 • • 7

lmstudio-community/Hermes-4-405B-MLX-5bit

Text Generation • 406B • Updated Aug 26, 2025 • 323

lmstudio-community/Hermes-4-405B-MLX-4bit

Text Generation • 406B • Updated Aug 26, 2025 • 815 • 1

lmstudio-community/Hermes-4-405B-MLX-6bit

Text Generation • 406B • Updated Aug 26, 2025 • 329

lmstudio-community/Hermes-4-405B-MLX-8bit

Text Generation • 406B • Updated Aug 26, 2025 • 527 • 1

mlx-community/Hermes-4-70B-4bit

Text Generation • 71B • Updated Aug 26, 2025 • 124

mlx-community/Hermes-4-70B-5bit

Text Generation • 71B • Updated Aug 26, 2025 • 62 • 2

mlx-community/Hermes-4-70B-6bit

Text Generation • 71B • Updated Aug 26, 2025 • 42

mlx-community/Hermes-4-70B-8bit

Text Generation • 71B • Updated Aug 26, 2025 • 124 • 2

unsloth/Hermes-4-70B-GGUF

71B • Updated Aug 27, 2025 • 3.05k • 24

unsloth/Hermes-4-70B

Text Generation • Updated Aug 27, 2025 • 69 • • 1

unsloth/Hermes-4-405B

Text Generation • Updated Aug 27, 2025 • 18 • 1

unsloth/Hermes-4-405B-GGUF

Text Generation • 406B • Updated Aug 28, 2025 • 1.03k • 4

mradermacher/Discord-Micae-Hermes-3-3B-GGUF

Text Generation • 3B • Updated Aug 27, 2025 • 191 • 5

mlx-community/Hermes-4-405B-4bit

Text Generation • 406B • Updated Aug 27, 2025 • 40 • 1

mradermacher/Discord-Micae-Hermes-3-3B-i1-GGUF

Text Generation • 3B • Updated Dec 23, 2025 • 163 • 4

cyankiwi/Hermes-4-70B-AWQ-4bit

Text Generation • 13B • Updated Aug 27, 2025 • 65.3k • 7

cyankiwi/Hermes-4-70B-AWQ-8bit

Text Generation • 21B • Updated Aug 30, 2025 • 6 • 1