RedHatAI
/

starcoder2-15b-quantized.w8a16

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

alexmarques commited on Aug 2, 2024

Commit

854eed8

·

verified ·

1 Parent(s): d98a62d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -141,7 +141,7 @@ We used Neural Magic's fork of [evalplus](https://github.com/neuralmagic/evalplu
 ```
 python codegen/generate.py \
   --model neuralmagic/starcoder2-15b-quantized.w8a16 \
-  --bs 16 \
   --temperature 0.2 \
   --n_samples 50 \
   --dataset humaneval \

 ```
 python codegen/generate.py \
   --model neuralmagic/starcoder2-15b-quantized.w8a16 \
+  --bs 8 \
   --temperature 0.2 \
   --n_samples 50 \
   --dataset humaneval \