Rename model to DeepJ TinyStories
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ tags:
|
|
| 8 |
- deepj
|
| 9 |
---
|
| 10 |
|
| 11 |
-
# DeepJ TinyStories
|
| 12 |
|
| 13 |
An experimental 1,301,120-parameter causal language model trained with DeepJ. On 100 deterministic TinyStories validation windows (12800 tokens), loss was 2.182273 and perplexity was 8.866.
|
| 14 |
|
|
|
|
| 8 |
- deepj
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# DeepJ TinyStories
|
| 12 |
|
| 13 |
An experimental 1,301,120-parameter causal language model trained with DeepJ. On 100 deterministic TinyStories validation windows (12800 tokens), loss was 2.182273 and perplexity was 8.866.
|
| 14 |
|