cherry-alpha / README.md
Banaxi-Tech's picture
Save 5% checkpoint at 1,000,341,504 tokens
dc2ef7f verified
|
Raw History Blame Contribute Delete
78 Bytes

5M transformer parameters, partially looped model.

40M in n-gram embeddings.