Update README.md
Browse files
README.md
CHANGED
|
@@ -47,7 +47,7 @@ To maximise efficiency while training, LS3 is a not a dense model, but rather a
|
|
| 47 |
| Tokens seen: | ~5.7B |
|
| 48 |
| GPU time (5060ti): | 8h |
|
| 49 |
|
| 50 |
-
*Note that it was trained with a 16k vocab, so 2.62M of the 5.52M active parameters are embedding.
|
| 51 |
|
| 52 |
## Chatbench results:
|
| 53 |
|
|
|
|
| 47 |
| Tokens seen: | ~5.7B |
|
| 48 |
| GPU time (5060ti): | 8h |
|
| 49 |
|
| 50 |
+
\*Note that it was trained with a 16k vocab, so 2.62M of the 5.52M active parameters are embedding.
|
| 51 |
|
| 52 |
## Chatbench results:
|
| 53 |
|