Update README.md
Browse files
README.md
CHANGED
|
@@ -20,7 +20,7 @@ pipeline_tag: text-generation
|
|
| 20 |
## Training Details
|
| 21 |
| Batch Size | Token Seen | lr |
|
| 22 |
|---|---|---|
|
| 23 |
-
| 1024 |
|
| 24 |
|
| 25 |
## License
|
| 26 |
apache-2.0
|
|
|
|
| 20 |
## Training Details
|
| 21 |
| Batch Size | Token Seen | lr |
|
| 22 |
|---|---|---|
|
| 23 |
+
| 1024 | 2.5B | 2e-3 (cosine)|
|
| 24 |
|
| 25 |
## License
|
| 26 |
apache-2.0
|