4.51 GB

Ctrl+K

1 contributor

History: 15 commits

Theskywalker07

Upload full run contents (scripts, checkpoints, and results) (part 13)

6d9f8c8 verified about 2 months ago

babylm_eval_repo
Upload full run contents (scripts, checkpoints, and results) (part 13) about 2 months ago
checkpoints
Upload full run contents (scripts, checkpoints, and results) (part 13) about 2 months ago
results
Upload full run contents (scripts, checkpoints, and results) (part 13) about 2 months ago
.DS_Store
6.15 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) about 2 months ago
.gitattributes
2.33 kB
Upload full run contents (scripts, checkpoints, and results) (part 12) about 2 months ago
README-2.md
3.26 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) about 2 months ago
configuration_xpertgpt.py
1.08 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) about 2 months ago
modeling_xpertgpt.py
19 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) about 2 months ago
train.py
72.6 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) about 2 months ago
training_terminal.log
1.39 MB
Upload full run contents (scripts, checkpoints, and results) (part 13) about 2 months ago
upload_all_hf.py
3.7 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) about 2 months ago
upload_project_hf.py
3.26 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) about 2 months ago