Minami-su
/

XVERSE-7B_2bit

Text Generation

text-generation-inference

Model card Files Files and versions

Minami-su commited on Dec 31, 2023

Commit

97a9f85

·

1 Parent(s): 377ef6e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,6 +6,6 @@ tags:
 - XVERSE
 ---
-You can run it on 2G mem GPU,quantize base QuIP# method, a weights-only quantization method that is able to achieve near fp16 performance using only 2 bits per weight.
 url:https://github.com/Cornell-RelaxML/quip-sharp/tree/release20231203

 - XVERSE
 ---
+You can run it on 4G mem GPU,quantize base QuIP# method, a weights-only quantization method that is able to achieve near fp16 performance using only 2 bits per weight.
 url:https://github.com/Cornell-RelaxML/quip-sharp/tree/release20231203