DaraV
/

LLaMA-3.1-8B-Instruct-INT4-GPTQ

4-bit precision

Model card Files Files and versions

LLaMA-3.1-8B Instruct model quantized to INT-4 using AutoGPTQ.

Downloads last month: 65

Safetensors

Model size

8B params

Tensor type

F16

·

I32

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DaraV/LLaMA-3.1-8B-Instruct-INT4-GPTQ

Base model

meta-llama/Llama-3.1-8B

Finetuned

meta-llama/Llama-3.1-8B-Instruct

Quantized

(569)

this model