Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,823

Base only

Active filters: th

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • 21B • Updated Aug 8, 2024 • 5 • 2

mradermacher/Meta-Llama-3.1-8B-i1-GGUF

8B • Updated Dec 16, 2024 • 925

mradermacher/Meta-Llama-3.1-70B-Instruct-GGUF

71B • Updated Dec 16, 2024 • 423 • 3

e2jhiubyiiyvw/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 10

mradermacher/Meta-Llama-3.1-70B-Instruct-i1-GGUF

71B • Updated Dec 16, 2024 • 320 • 2

vicky4s4s/llama-3.1-8B-instruct

Text Generation • 8B • Updated Jul 31, 2024 • 6

mradermacher/Meta-Llama-3.1-70B-GGUF

71B • Updated Dec 16, 2024 • 203

SeaLLMs/SeaLLMs-v3-1.5B

Text Generation • 2B • Updated Jul 30, 2024 • 194 • • 5

chrypnotoad/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 9

apoorvparmar007/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 8

parinzee/llama3-seed-free-synthetic-instruct-fcd-8b

Text Generation • Updated Jul 29, 2024 • 2 • 2

mradermacher/Meta-Llama-3.1-70B-i1-GGUF

71B • Updated Dec 16, 2024 • 677 • 2

mradermacher/Meta-Llama-3.1-405B-Instruct-GGUF

Updated Dec 16, 2024 • 6

reach-vb/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 132 • 8

livil/llama3.1-8b-instruct

Text Generation • 8B • Updated Jul 30, 2024 • 9 •

Niansuh/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 30, 2024 • 3

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Feb 11, 2025 • 7.51k • 21

Kaan35/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 5

aisingapore/Llama-SEA-LION-v2-8B

Text Generation • 8B • Updated Jun 10 • 28 • • 4

aisingapore/Llama-SEA-LION-v2-8B-IT

Text Generation • 8B • Updated Jun 8 • 94 • • 17

kaetemi/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 170 • 1

DavidLanz/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 30, 2024 • 14 • 2

pvbhanuteja/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 30, 2024 • 5 • 1

aisingapore/Llama-SEA-LION-v2-8B-IT-GGUF

8B • Updated Jun 10 • 412 • 3

nguyenphuthien/SeaLLMs-v3-7B-Chat-Q8_0-GGUF

8B • Updated Jul 30, 2024 • 7

jitsi/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 30, 2024 • 4

vaibhavsatpathy/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 7

adonald/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 8

vaibhavsatpathy/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 5

Dabitron/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 3