4darsh-Dev
/

Meta-Llama-3-8B-quantized-GPTQ

Text Generation

llama-3-8b-quantized

llama-3-8b-autogptq

4-bit precision

Model card Files Files and versions

Model Card for 4darsh-Dev/Meta-Llama-3-8B-autogptq-4bit

This repo contains 4-bit quantized (using autogptq and peft) model of Meta's Meta-Llama-3-8B

Model Details

Model creator: Meta
Original model: Meta-Llama-3-8B-Instruct

Downloads last month: -