Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -92,6 +92,7 @@ is 5 MB of text that none of the models trained on.
|
|
| 92 |
## More
|
| 93 |
|
| 94 |
- Article: [Can a model learn its own tokenizer?](https://claude.ai/artifact/AamTLQSJGp6uYueALTKjtm)
|
|
|
|
| 95 |
- Training data: [ShadeEngine/fineweb-edu-bytes-10BT](https://huggingface.co/datasets/ShadeEngine/fineweb-edu-bytes-10BT)
|
| 96 |
and [ShadeEngine/fineweb-edu-bpe32k-10BT](https://huggingface.co/datasets/ShadeEngine/fineweb-edu-bpe32k-10BT)
|
| 97 |
- The experiment follows Cartesia's
|
|
|
|
| 92 |
## More
|
| 93 |
|
| 94 |
- Article: [Can a model learn its own tokenizer?](https://claude.ai/artifact/AamTLQSJGp6uYueALTKjtm)
|
| 95 |
+
- Training and evaluation code: [https://github.com/Ganryuu/bytegpt](https://github.com/Ganryuu/bytegpt)
|
| 96 |
- Training data: [ShadeEngine/fineweb-edu-bytes-10BT](https://huggingface.co/datasets/ShadeEngine/fineweb-edu-bytes-10BT)
|
| 97 |
and [ShadeEngine/fineweb-edu-bpe32k-10BT](https://huggingface.co/datasets/ShadeEngine/fineweb-edu-bpe32k-10BT)
|
| 98 |
- The experiment follows Cartesia's
|