Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,084

Base only

Active filters: pt

aftersoft/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 17, 2024 • 10

ek826/Meta-Llama-3.1-405B-Instruct-4.25bpw-gqa-exl2

Text Generation • Updated Aug 17, 2024 • 4 • 1

AvantgardaQalbuPernada/Equinox

Updated Aug 18, 2024

ghost-x/ghost-8b-beta-1608

Text Generation • 8B • Updated Aug 23, 2024 • 9.4k • • 34

irresistiblegrace97/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 18, 2024 • 10

ghost-x/ghost-8b-beta-1608-awq

Text Generation • 8B • Updated Aug 23, 2024 • 3 • 1

ghost-x/ghost-8b-beta-1608-gguf

Text Generation • 8B • Updated Aug 26, 2024 • 91 • 6

teddylee777/ghost-8b-beta-1608-gguf

Text Generation • 8B • Updated Aug 18, 2024 • 175 • 1

Epiculous/Azure_Dusk-v0.1

Text Generation • 12B • Updated Aug 24, 2024 • 11 • 6

Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • 8B • Updated Aug 18, 2024 • 6 • 1

anthracite-org/magnum-v2-72b

Text Generation • 73B • Updated Oct 12, 2024 • 102 • • 40

anthracite-org/magnum-v2-123b-gguf

Text Generation • 123B • Updated Aug 22, 2024 • 208 • 14

anthracite-org/magnum-v2-123b-exl2

Text Generation • Updated Aug 19, 2024 • 3

anthracite-org/magnum-v2-72b-exl2

Text Generation • Updated Aug 22, 2024 • 4 • 3

lanok/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 19, 2024 • 5

ai21labs/AI21-Jamba-Mini-1.5

Text Generation • 52B • Updated Feb 2 • 14.2k • 271

ai21labs/AI21-Jamba-Large-1.5

Text Generation • 399B • Updated Feb 2 • 49 • 220

CohereLabs/c4ai-command-r-08-2024

Text Generation • 32B • Updated Oct 30, 2025 • 2.62k • • 173

antoste/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Aug 19, 2024 • 11

mozilla-ai/Meta-Llama-3.1-70B-Instruct-llamafile

Updated about 6 hours ago • 2.98k • 10

mozilla-ai/Mistral-Nemo-Instruct-2407-llamafile

Updated Aug 20, 2024 • 699 • 6

mbuali/Llama-3.1-8B-DALv0.1

Text Generation • Updated Aug 19, 2024 • 4

RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • 406B • Updated Dec 3, 2024 • 32 • 2

Cran-May/ghost-8b-beta-1608-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 19, 2024 • 8

RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • 406B • Updated Oct 9, 2024 • 18 • 1

bartowski/Llama-3.1-Storm-8B-GGUF

Text Generation • 8B • Updated Aug 20, 2024 • 1.72k • 6

wgtcarlos/gmalogo

Updated Aug 19, 2024 • 2

anthracite-org/magnum-v2-72b-gguf

Text Generation • 73B • Updated Sep 26, 2024 • 493 • 3

Proverbial1/magnum-v2-123b_exl2_5.0bpw_h8

Text Generation • Updated Aug 20, 2024 • 3

realsaturnapp/testplanner3-llama3.1

Text Generation • 8B • Updated Aug 22, 2024 • 7