Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
license: apache-2.0
|
| 2 |
---
|
| 3 |
-
# GreenBit
|
| 4 |
|
| 5 |
This is GreenBitAI's pretrained **2-bit** Yi 6B model with extreme compression yet still strong performance.
|
| 6 |
|
|
@@ -14,7 +14,7 @@ Please refer to our [Github page](https://github.com/GreenBitAI/low_bit_llama) f
|
|
| 14 |
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0), [Llama 2 license agreement](https://ai.meta.com/resources/models-and-libraries/llama-downloads/)
|
| 15 |
|
| 16 |
## Zero-Shot Evaluation
|
| 17 |
-
| Task | Metric | FP16 | 6B w4a16g32 | 6B w2a16g8
|
| 18 |
|-----------------|--------|-------|-------------|----------------------|-----------------------|
|
| 19 |
| Openbookqa | acc | 0.314 | 0.324 | 0.26 | 0.228 |
|
| 20 |
| | ac_norm| 0.408 | 0.42 | 0.394 | 0.352 |
|
|
|
|
| 1 |
license: apache-2.0
|
| 2 |
---
|
| 3 |
+
# GreenBit Yi
|
| 4 |
|
| 5 |
This is GreenBitAI's pretrained **2-bit** Yi 6B model with extreme compression yet still strong performance.
|
| 6 |
|
|
|
|
| 14 |
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0), [Llama 2 license agreement](https://ai.meta.com/resources/models-and-libraries/llama-downloads/)
|
| 15 |
|
| 16 |
## Zero-Shot Evaluation
|
| 17 |
+
| Task | Metric | FP16 | Yi-6B w4a16g32 | Yi-6B w2a16g8 | Yi-6B w2a16g32|
|
| 18 |
|-----------------|--------|-------|-------------|----------------------|-----------------------|
|
| 19 |
| Openbookqa | acc | 0.314 | 0.324 | 0.26 | 0.228 |
|
| 20 |
| | ac_norm| 0.408 | 0.42 | 0.394 | 0.352 |
|