Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,465

Full-text search

Active filters: chat

objects76/qwen2-xlam

Text Generation • 2B • Updated Aug 21, 2024

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_2.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 1

drexample/magnum-v2-123b-exl2-5.0bpw

Text Generation • Updated Aug 21, 2024 • 1

QuantFactory/magnum-v2.5-12b-kto-GGUF

Text Generation • 12B • Updated Aug 21, 2024 • 36 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_3.0bpw_h6

Text Generation • Updated Aug 21, 2024 • 1

WallStarer/magnum-v2-123b_Exl2_4.25bpw

Text Generation • Updated Aug 21, 2024

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_3.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 1

drexample/magnum-v2-123b-exl2-5.6bpw

Text Generation • Updated Aug 21, 2024

thibaud/Hermes-3-Llama-3.1-70B-FP8-v0

71B • Updated Aug 21, 2024 • 5

NikolayKozloff/ghost-8b-beta-1608-Q8_0-GGUF

Text Generation • 8B • Updated Aug 21, 2024 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.0bpw_h6

Text Generation • Updated Aug 21, 2024

WallStarer/magnum-v2-123b_Exl2_3.75bpw

Text Generation • Updated Aug 21, 2024

mradermacher/magnum-v2-72b-GGUF

73B • Updated Sep 8, 2024 • 70 • 2

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 1

mradermacher/magnum-v2-72b-i1-GGUF

73B • Updated Sep 8, 2024 • 92 • 5

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.0bpw_h6

Text Generation • Updated Aug 22, 2024

bartowski/magnum-v2-123b-GGUF

Text Generation • 123B • Updated Aug 22, 2024 • 116 • 3

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.5bpw_h6

Text Generation • Updated Aug 22, 2024

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_6.0bpw_h6

Text Generation • Updated Aug 22, 2024

bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2

Updated Aug 22, 2024

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_6.5bpw_h8

Text Generation • Updated Aug 22, 2024

hellork/CodeQwen1.5-7B-Chat-IQ4_NL-GGUF

Text Generation • 7B • Updated Sep 17, 2024 • 3

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.0bpw_h8

Text Generation • Updated Aug 22, 2024

QuantFactory/ghost-8b-beta-1608-GGUF

Text Generation • 8B • Updated Aug 23, 2024 • 219 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.5bpw_h8

Text Generation • Updated Aug 23, 2024

QuantFactory/ghost-7b-alpha-GGUF

Text Generation • 7B • Updated Aug 23, 2024 • 106 • 2

MaziyarPanahi/calme-2.1-phi3.5-4b

Text Generation • 4B • Updated Sep 4, 2024 • 30 • 4

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_8.0bpw_h8

Text Generation • Updated Aug 23, 2024 • 2

ghost-x/ghost-8b-beta-1608-mlx

Text Generation • Updated Aug 23, 2024 • 8

bartowski/calme-2.1-phi3.5-4b-GGUF

Text Generation • 4B • Updated Aug 23, 2024 • 266 • 2