Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,8 @@ tags: []
|
|
| 7 |
|
| 8 |
UPDATE: Thanks to the work of my student [Serdar Gülbahar](https://github.com/serdardoesml), the reason for this model scoring well has been traced to a few bugs in the babylm evaluation pipeline.
|
| 9 |
The issue is currently being fixed here: https://github.com/babylm/evaluation-pipeline-2025/issues/34
|
| 10 |
-
|
|
|
|
| 11 |
|
| 12 |
|
| 13 |
This is a model I accidentally trained with too low a batch size, causing the training loss to spike and essentially fail.
|
|
|
|
| 7 |
|
| 8 |
UPDATE: Thanks to the work of my student [Serdar Gülbahar](https://github.com/serdardoesml), the reason for this model scoring well has been traced to a few bugs in the babylm evaluation pipeline.
|
| 9 |
The issue is currently being fixed here: https://github.com/babylm/evaluation-pipeline-2025/issues/34
|
| 10 |
+
|
| 11 |
+
After this is fixed, this model should perform quite poorly, as expected.
|
| 12 |
|
| 13 |
|
| 14 |
This is a model I accidentally trained with too low a batch size, causing the training loss to spike and essentially fail.
|