kaitchup
/

Yi-6B-awq-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

bnjmnmarie commited on Mar 21, 2024

Commit

faff76c

·

verified ·

1 Parent(s): 8df8790

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -4,13 +4,13 @@ language:
 - zh
 library_name: transformers
 tags:
-- auto-gptq
 ---
 ## Model Details
-This is 01-ai/Yi-6B quantized and serialized with AutoGPTQ in 4-bit.
 Details here:

 - zh
 library_name: transformers
 tags:
+- autoawq
 ---
 ## Model Details
+This is 01-ai/Yi-6B quantized and serialized with AutoAWQ in 4-bit.
 Details here: