shuyuej
/

Command-R-Plus-Smaller-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

shuyuej commited on Jul 22, 2024

Commit

ee0eb8a

·

verified ·

1 Parent(s): 26f4d75

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ Link: [https://huggingface.co/CohereForAI/c4ai-command-r-plus](https://huggingfa
 We use `group_size=1024` to quantize a smaller model.
 For the default `group_size=128`, the model is also available here: [https://huggingface.co/shuyuej/Command-R-Plus-GPTQ](https://huggingface.co/shuyuej/Command-R-Plus-GPTQ).
-## Quantization Configurations:
 ```text
 "quantization_config": {

 We use `group_size=1024` to quantize a smaller model.
 For the default `group_size=128`, the model is also available here: [https://huggingface.co/shuyuej/Command-R-Plus-GPTQ](https://huggingface.co/shuyuej/Command-R-Plus-GPTQ).
+## Quantization Configurations
 ```text
 "quantization_config": {