Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,539

Full-text search

Active filters: meta

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Sep 22, 2025 • 18.8k • 20

lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 28, 2024 • 1.27k • 36

bigstorm/Meta-Llama-3.1-70B-Instruct-6.5bpw-8hb-exl2

Text Generation • Updated Jul 24, 2024

mlx-community/Meta-Llama-3.1-405B-2bit

Text Generation • 38B • Updated Jul 24, 2024 • 44 • 2

LoneStriker/Meta-Llama-3.1-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 1

kowlick/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024

LoneStriker/Meta-Llama-3.1-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 1

LoneStriker/Meta-Llama-3.1-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 5

LoneStriker/Meta-Llama-3.1-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 1

LoneStriker/Meta-Llama-3.1-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024

second-state/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 597 • 4

gaianet/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 8, 2025 • 466

LoneStriker/Meta-Llama-3.1-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 1 • 5

LoneStriker/Meta-Llama-3.1-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Jul 24, 2024

adrlau/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 112

rainjay/Meta-Llama-3.1-8B-Instruct-4bit

Text Generation • 8B • Updated Jul 24, 2024

NousResearch/Meta-Llama-3.1-8B

Text Generation • 8B • Updated Jul 25, 2024 • 6.12k • • 18

NousResearch/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 24, 2024 • 205k • • 39

NousResearch/Meta-Llama-3.1-70B

Text Generation • 71B • Updated Jul 26, 2024 • 302 • • 7

NousResearch/Meta-Llama-3.1-70B-Instruct

Text Generation • 71B • Updated Jul 24, 2024 • 4.33k • • 13

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 1

atcsecure/llama3.1-70b-instruct-8.0bpw-h8-exl2

Text Generation • Updated Jul 24, 2024

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • 71B • Updated Aug 7, 2024 • 5.29k • 23

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 18.7k • 41

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 1.52k • 2

joshnader/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 13 • 1

zak66/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 4

zak66/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 2

callitaclue/Meta-Llama-3.1-8B-Instruct-Q5_K_S-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 37

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 198 • 7