llama-on-cpp - a japolo95 Collection

japolo95 's Collections

llama-on-cpp

updated Aug 19, 2024

Running on A10G

2.12k

GGUF My Repo

🦙

2.12k

Quantize a Hugging Face model into GGUF format
meta-llama/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Sep 25, 2024 • 4.35M • • 8.84k
meta-llama/Llama-3.1-70B-Instruct

Text Generation • 71B • Updated Dec 15, 2024 • 92.2k • • 1.03k