styalai
/

phi-2_quantize_gptq

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Model Card for Model ID

Model Details

It's just the model Phi-2 by microsoft quantized by gptq in 4 bits.

Downloads last month: 5

Safetensors

Model size

3B params

Tensor type

I32

·

F16

·