Model Card for 4darsh-Dev/Meta-Llama-3-8B-autogptq-4bit
This repo contains 4-bit quantized (using autogptq and peft) model of Meta's Meta-Llama-3-8B
Model Details
- Model creator: Meta
- Original model: Meta-Llama-3-8B-Instruct
- Downloads last month
- -
This repo contains 4-bit quantized (using autogptq and peft) model of Meta's Meta-Llama-3-8B
docker model run hf.co/4darsh-Dev/Meta-Llama-3-8B-quantized-GPTQ