Update README.md
Browse files
README.md
CHANGED
|
@@ -6,6 +6,17 @@ library_name: transformers
|
|
| 6 |
---
|
| 7 |
|
| 8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
This model was created with the help of several members of Anthracite.
|
| 10 |
|
| 11 |
This is a 4B parameter Minitron derivative healed and then tuned on 100M high quality instruction following tokens. This model was tuned at 8k context. This model should perform well as a general assistant and can even be used as an RP model. Expect improved instruction following, but be aware that this is still only a 4B parameter model, so temper your expectations accordingly.
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
|
| 9 |
+
```
|
| 10 |
+
|
| 11 |
+
| Groups |Version|Filter|n-shot|Metric| |Value | |Stderr|
|
| 12 |
+
|------------------|------:|------|------|------|---|-----:|---|-----:|
|
| 13 |
+
|mmlu | 2|none | |acc |_ |0.5922|_ |0.0039|
|
| 14 |
+
| - humanities | 2|none | |acc |_ |0.5522|_ |0.0068|
|
| 15 |
+
| - other | 2|none | |acc |_ |0.6579|_ |0.0082|
|
| 16 |
+
| - social sciences| 2|none | |acc |_ |0.6815|_ |0.0082|
|
| 17 |
+
| - stem | 2|none | |acc |_ |0.5002|_ |0.0086|
|
| 18 |
+
```
|
| 19 |
+
|
| 20 |
This model was created with the help of several members of Anthracite.
|
| 21 |
|
| 22 |
This is a 4B parameter Minitron derivative healed and then tuned on 100M high quality instruction following tokens. This model was tuned at 8k context. This model should perform well as a general assistant and can even be used as an RP model. Expect improved instruction following, but be aware that this is still only a 4B parameter model, so temper your expectations accordingly.
|