hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4 Text Generation • 71B • Updated Aug 7, 2024 • 3.52k • 23
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4 Text Generation • 8B • Updated Aug 7, 2024 • 9.74k • 42
joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF Text Generation • 8B • Updated Jul 24, 2024 • 3.39k • 7
deven367/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF Text Generation • 8B • Updated Jul 24, 2024 • 522 • 1
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 71B • Updated Oct 9, 2024 • 11 • 5
qwp4w3hyb/Meta-Llama-3.1-70B-Instruct-iMat-GGUF Text Generation • 71B • Updated Aug 6, 2024 • 447 • 8