Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,002

Base only

Active filters: chat

hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF

Text Generation • 8B • Updated Sep 17, 2024 • 16

mradermacher/Hermes-3-Llama-3.1-405B-i1-GGUF

Updated Aug 20, 2024 • 2

Orion-zhen/Hermes-3-Llama-3.1-70B-4.5bpw-exl2

Updated Aug 18, 2024

dlhaojin/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Aug 18, 2024 • 2

bartowski/Hermes-3-Llama-3.1-405B-GGUF

Text Generation • 406B • Updated Sep 27, 2024 • 619 • 14

QuantFactory/Llama3.1-8B-Enigma-GGUF

Text Generation • 8B • Updated Aug 28, 2024 • 140 • 1

ghost-x/ghost-8b-beta-1608

Text Generation • 8B • Updated Aug 23, 2024 • 9.53k • • 34

ghost-x/ghost-8b-beta-1608-awq

Text Generation • 8B • Updated Aug 23, 2024 • 2 • 1

ghost-x/ghost-8b-beta-1608-gguf

Text Generation • 8B • Updated Aug 26, 2024 • 100 • 6

teddylee777/ghost-8b-beta-1608-gguf

Text Generation • 8B • Updated Aug 18, 2024 • 229 • 1

anthracite-org/magnum-v2-72b

Text Generation • 73B • Updated Oct 12, 2024 • 81 • • 40

anthracite-org/magnum-v2-123b-gguf

Text Generation • 123B • Updated Aug 22, 2024 • 110 • 14

anthracite-org/magnum-v2-123b-exl2

Text Generation • Updated Aug 19, 2024 • 3

anthracite-org/magnum-v2-72b-exl2

Text Generation • Updated Aug 22, 2024 • 3

Cran-May/ghost-8b-beta-1608-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 19, 2024 • 14

kevinbayes/Hermes-3-Llama-3.1-8B.llamafile

Updated Aug 19, 2024 • 1

anthracite-org/magnum-v2-72b-gguf

Text Generation • 73B • Updated Sep 26, 2024 • 101 • 3

Proverbial1/magnum-v2-123b_exl2_5.0bpw_h8

Text Generation • Updated Aug 20, 2024 • 2

mradermacher/magnum-v2-123b-GGUF

123B • Updated Sep 8, 2024 • 21 • 6

Junrui2021/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 11, 2024 • 3

mradermacher/magnum-v2-123b-i1-GGUF

123B • Updated Sep 8, 2024 • 112 • 7

drexample/magnum-v2-123b-exl2-6.0bpw

Text Generation • Updated Aug 20, 2024 • 1

Nekuromento/ghost-8b-beta-1608-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 20, 2024 • 10

Nekuromento/ghost-8b-beta-1608-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 20, 2024 • 2

WallStarer/magnum-v2-123b_Exl2_3.5bpw

Text Generation • Updated Aug 21, 2024 • 1

Nekuromento/ghost-8b-beta-1608-Q6_K-GGUF

Text Generation • 8B • Updated Aug 20, 2024 • 3

objects76/qwen2-xlam

Text Generation • 2B • Updated Aug 21, 2024 • 2

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_2.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 1 • 1

drexample/magnum-v2-123b-exl2-5.0bpw

Text Generation • Updated Aug 21, 2024 • 6 • 1

QuantFactory/magnum-v2.5-12b-kto-GGUF

Text Generation • 12B • Updated Aug 21, 2024 • 18 • 1