Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,7 @@ Please refer to our [Github page](https://github.com/GreenBitAI/low_bit_llama) f
|
|
| 13 |
- **Language(s) (NLP):** English
|
| 14 |
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0), [Llama 2 license agreement](https://ai.meta.com/resources/models-and-libraries/llama-downloads/)
|
| 15 |
|
|
|
|
| 16 |
| Task | Metric | FP16 | 6B w4a16g32 | 6B w2a16g8 wikitext2 | 6B w2a16g32 wikitext2 |
|
| 17 |
|-----------------|--------|-------|-------------|----------------------|-----------------------|
|
| 18 |
| Openbookqa | acc | 0.314 | 0.324 | 0.26 | 0.228 |
|
|
|
|
| 13 |
- **Language(s) (NLP):** English
|
| 14 |
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0), [Llama 2 license agreement](https://ai.meta.com/resources/models-and-libraries/llama-downloads/)
|
| 15 |
|
| 16 |
+
## Zero-Shot Evaluation
|
| 17 |
| Task | Metric | FP16 | 6B w4a16g32 | 6B w2a16g8 wikitext2 | 6B w2a16g32 wikitext2 |
|
| 18 |
|-----------------|--------|-------|-------------|----------------------|-----------------------|
|
| 19 |
| Openbookqa | acc | 0.314 | 0.324 | 0.26 | 0.228 |
|