Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,678

Base only

Active filters: chat

WallStarer/magnum-v2-123b_Exl2_3.75bpw

Text Generation • Updated Aug 21, 2024 • 2

mradermacher/magnum-v2-72b-GGUF

73B • Updated Sep 8, 2024 • 264 • 2

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 3 • 1

mradermacher/magnum-v2-72b-i1-GGUF

73B • Updated Sep 8, 2024 • 520 • 5

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.0bpw_h6

Text Generation • Updated Aug 22, 2024 • 3

bartowski/magnum-v2-123b-GGUF

Text Generation • 123B • Updated Aug 22, 2024 • 336 • 3

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.5bpw_h6

Text Generation • Updated Aug 22, 2024 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_6.0bpw_h6

Text Generation • Updated Aug 22, 2024 • 3

bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2

Updated Aug 22, 2024 • 3

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_6.5bpw_h8

Text Generation • Updated Aug 22, 2024 • 2

hellork/CodeQwen1.5-7B-Chat-IQ4_NL-GGUF

Text Generation • 7B • Updated Sep 17, 2024 • 19

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.0bpw_h8

Text Generation • Updated Aug 22, 2024 • 3

QuantFactory/ghost-8b-beta-1608-GGUF

Text Generation • 8B • Updated Aug 23, 2024 • 251 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.5bpw_h8

Text Generation • Updated Aug 23, 2024 • 8

QuantFactory/ghost-7b-alpha-GGUF

Text Generation • 7B • Updated Aug 23, 2024 • 132 • 2

MaziyarPanahi/calme-2.1-phi3.5-4b

Text Generation • 4B • Updated Sep 4, 2024 • 39 • • 4

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_8.0bpw_h8

Text Generation • Updated Aug 23, 2024 • 8 • 2

ghost-x/ghost-8b-beta-1608-mlx

Text Generation • Updated Aug 23, 2024 • 9

bartowski/calme-2.1-phi3.5-4b-GGUF

Text Generation • 4B • Updated Aug 23, 2024 • 327 • 2

jacobcarajo/Qwen2-Math-7B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 23, 2024 • 7

anthracite-org/magnum-v2-4b-exl2

Text Generation • Updated Aug 27, 2024 • 1

anthracite-org/magnum-v2-4b-gguf

Text Generation • 5B • Updated Aug 27, 2024 • 79 • 8

bullerwins/Hermes-3-Llama-3.1-8B-exl2_4.0bpw

Updated Aug 23, 2024 • 6

anthracite-org/magnum-v2-4b

Text Generation • 5B • Updated Aug 27, 2024 • 21 • 22

emplitude/offtheshelf2

Updated Aug 23, 2024 • 1

bullerwins/Hermes-3-Llama-3.1-8B-exl2_5.0bpw

Updated Aug 23, 2024 • 6

bullerwins/Hermes-3-Llama-3.1-8B-exl2_6.0bpw

Updated Aug 23, 2024 • 5

bullerwins/Hermes-3-Llama-3.1-8B-exl2_8.0bpw

Updated Aug 23, 2024 • 3

unclemusclez/tinyllama-chat-Q2_K-GGUF

1B • Updated Aug 23, 2024 • 8

unclemusclez/tinyllama-chat-IQ3_XXS-GGUF

1B • Updated Aug 23, 2024 • 6