localmodels
/

vicuna-7b-v1.1-4bit

Model card Files Files and versions

vicuna-7b-v1.1-4bit / README.md

x0001's picture

Vicuna 7B v1.1 4-bit

dae3ba3 almost 3 years ago

|

160 Bytes

Vicuna 7B v1.1 4-bit

From lmsys: https://huggingface.co/lmsys/vicuna-7b-delta-v1.1

Folders

ggml: q4_0 and q4_1

gptq: works with Triton branch