438 kB

Ctrl+K

Fix config params to the true unique count (100,936). 106,568 is the file sum that double-counts the tied head; the README explains this.

b3bc31f verified 4 days ago

.gitattributes

1.52 kB
initial commit 4 days ago
README.md

4.45 kB
Correct the card: the model is now trained on the 19.2 MB TinyStories validation set (the actual #17 request). Fixes param count (100,936 unique; the earlier 106,568 double-counted the tied head) and reports the honest memorization result (ratio 1.02x, verified reproducible). 4 days ago
config.json

374 Bytes
Fix config params to the true unique count (100,936). 106,568 is the file sum that double-counts the tied head; the README explains this. 4 days ago
model.safetensors

431 kB
xet

Ship the correct Testr-100K model (trained on the 19.2 MB TinyStories validation set, as requested in #17). Replaces the wrong-data weights (191 MB web text). 100,936 unique params; memorized PPL 3.1540 vs never-seen 3.2203 (ratio 1.02x) — verified reproducible from this file. 4 days ago
vocab.json

1.32 kB
Add char vocabulary (128 chars + unk) (#3) 4 days ago