Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ tags:
|
|
| 11 |
- tiny
|
| 12 |
---
|
| 13 |
|
| 14 |
-
## Tiny-LM-
|
| 15 |
A nano-sized language model (8M parameters) that demonstrates the power of high-quality synthetic data.
|
| 16 |
Despite its tiny size, it achieves a significant portion of GPT-2's (124M) performance by training on distilled and
|
| 17 |
simplified English datasets.
|
|
|
|
| 11 |
- tiny
|
| 12 |
---
|
| 13 |
|
| 14 |
+
## Tiny-LM-8M
|
| 15 |
A nano-sized language model (8M parameters) that demonstrates the power of high-quality synthetic data.
|
| 16 |
Despite its tiny size, it achieves a significant portion of GPT-2's (124M) performance by training on distilled and
|
| 17 |
simplified English datasets.
|