babylm-seqlen
/

mamba-512-warmup-v2

Model card Files Files and versions

mamba-512-warmup-v2

637 MB

1 contributor

History: 29 commits

rdiehlmartinez's picture

Checkpoint step: 49,911 | Target words: 1,000,000,000 | Actual tokens: 1,635,483,648 | Actual words: 1,000,000,000.0000001 | Progress: 28/28

6f742e2 verified 6 months ago

.gitattributes
1.52 kB

initial commit 6 months ago
config.json
765 Bytes

Checkpoint step: 50 | Target words: 1,000,000 | Actual tokens: 1,638,400 | Actual words: 1,001,783.1740498088 | Progress: 1/28 6 months ago
model.safetensors
637 MB
xet

Checkpoint step: 49,911 | Target words: 1,000,000,000 | Actual tokens: 1,635,483,648 | Actual words: 1,000,000,000.0000001 | Progress: 28/28 6 months ago
training_args.bin
5.84 kB
xet

Checkpoint step: 50 | Target words: 1,000,000 | Actual tokens: 1,638,400 | Actual words: 1,001,783.1740498088 | Progress: 1/28 6 months ago