Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,996

Base only

Active filters: chat

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_3.0bpw_h6

Text Generation • Updated Aug 21, 2024 • 2 • 1

WallStarer/magnum-v2-123b_Exl2_4.25bpw

Text Generation • Updated Aug 21, 2024 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_3.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 1 • 1

drexample/magnum-v2-123b-exl2-5.6bpw

Text Generation • Updated Aug 21, 2024 • 1

NikolayKozloff/ghost-8b-beta-1608-Q8_0-GGUF

Text Generation • 8B • Updated Aug 21, 2024 • 2 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.0bpw_h6

Text Generation • Updated Aug 21, 2024 • 1

WallStarer/magnum-v2-123b_Exl2_3.75bpw

Text Generation • Updated Aug 21, 2024 • 1

mradermacher/magnum-v2-72b-GGUF

73B • Updated Sep 8, 2024 • 116 • 2

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 1 • 1

mradermacher/magnum-v2-72b-i1-GGUF

73B • Updated Sep 8, 2024 • 223 • 5

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.0bpw_h6

Text Generation • Updated Aug 22, 2024 • 1

bartowski/magnum-v2-123b-GGUF

Text Generation • 123B • Updated Aug 22, 2024 • 357 • 3

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.5bpw_h6

Text Generation • Updated Aug 22, 2024 • 3

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_6.0bpw_h6

Text Generation • Updated Aug 22, 2024 • 1

bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2

Updated Aug 22, 2024 • 2

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_6.5bpw_h8

Text Generation • Updated Aug 22, 2024 • 1

hellork/CodeQwen1.5-7B-Chat-IQ4_NL-GGUF

Text Generation • 7B • Updated Sep 17, 2024 • 19

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.0bpw_h8

Text Generation • Updated Aug 22, 2024 • 1

QuantFactory/ghost-8b-beta-1608-GGUF

Text Generation • 8B • Updated Aug 23, 2024 • 174 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.5bpw_h8

Text Generation • Updated Aug 23, 2024 • 1

QuantFactory/ghost-7b-alpha-GGUF

Text Generation • 7B • Updated Aug 23, 2024 • 179 • 2

MaziyarPanahi/calme-2.1-phi3.5-4b

Text Generation • 4B • Updated Sep 4, 2024 • 18 • 4

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_8.0bpw_h8

Text Generation • Updated Aug 23, 2024 • 1 • 2

ghost-x/ghost-8b-beta-1608-mlx

Text Generation • Updated Aug 23, 2024 • 12

bartowski/calme-2.1-phi3.5-4b-GGUF

Text Generation • 4B • Updated Aug 23, 2024 • 189 • 2

jacobcarajo/Qwen2-Math-7B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 23, 2024 • 8

anthracite-org/magnum-v2-4b-exl2

Text Generation • Updated Aug 27, 2024 • 8

anthracite-org/magnum-v2-4b-gguf

Text Generation • 5B • Updated Aug 27, 2024 • 235 • 8

bullerwins/Hermes-3-Llama-3.1-8B-exl2_4.0bpw

Updated Aug 23, 2024 • 1

anthracite-org/magnum-v2-4b

Text Generation • 5B • Updated Aug 27, 2024 • 12 • 22