Models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • 3B • Updated Oct 23, 2024 • 3.25k • 12

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Sep 22, 2025 • 4.7k • 19

lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 28, 2024 • 563 • 36

bigstorm/Meta-Llama-3.1-70B-Instruct-6.5bpw-8hb-exl2

Text Generation • Updated Jul 24, 2024 • 5

mlx-community/Meta-Llama-3.1-405B-2bit

Text Generation • 38B • Updated Jul 24, 2024 • 31 • 2

intervitens/mini-magnum-12b-v1.1

Text Generation • 12B • Updated Aug 7, 2024 • 17 • 79

kowlick/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

12B • Updated Jul 24, 2024 • 1

LoneStriker/Meta-Llama-3.1-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 3

kowlick/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 2

LoneStriker/Meta-Llama-3.1-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 4

LoneStriker/Meta-Llama-3.1-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 4

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 121k • 14

LoneStriker/Meta-Llama-3.1-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 3

LoneStriker/Meta-Llama-3.1-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 3

second-state/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 598 • 4

gaianet/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 8, 2025 • 243

LoneStriker/Meta-Llama-3.1-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 4 • 5

LoneStriker/Meta-Llama-3.1-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 3

adrlau/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 5

Quant-Cartel/mini-magnum-12b-v1.1-exl2-longcal

Updated Jul 24, 2024 • 3

rainjay/Meta-Llama-3.1-8B-Instruct-4bit

Text Generation • 8B • Updated Jul 24, 2024 • 2

NousResearch/Meta-Llama-3.1-8B

Text Generation • 8B • Updated Jul 25, 2024 • 5.61k • • 18

NousResearch/Meta-Llama-3.1-70B

Text Generation • 71B • Updated Jul 26, 2024 • 238 • • 7

NousResearch/Meta-Llama-3.1-70B-Instruct

Text Generation • 71B • Updated Jul 24, 2024 • 788 • • 12

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024

atcsecure/llama3.1-70b-instruct-8.0bpw-h8-exl2

Text Generation • Updated Jul 24, 2024 • 5

mistralai/Mistral-Large-Instruct-2407

123B • Updated Jul 28, 2025 • 5.16k • 853

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • 71B • Updated Aug 7, 2024 • 590 • 23

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 4.45k • 40

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 1.63k • 2