babylm-seqlen
/

mamba-1024-warmup-v2

Model card Files Files and versions

mamba-1024-warmup-v2

637 MB

1 contributor

History: 29 commits

rdiehlmartinez's picture

Checkpoint step: 24,946 | Target words: 1,000,000,000 | Actual tokens: 1,634,861,056 | Actual words: 1,000,000,000.0 | Progress: 28/28

c5c7a98 verified 6 months ago

.gitattributes
1.52 kB

initial commit 6 months ago
config.json
765 Bytes

Checkpoint step: 25 | Target words: 1,000,000 | Actual tokens: 1,638,400 | Actual words: 1,002,164.6756995108 | Progress: 1/28 6 months ago
model.safetensors
637 MB
xet

Checkpoint step: 24,946 | Target words: 1,000,000,000 | Actual tokens: 1,634,861,056 | Actual words: 1,000,000,000.0 | Progress: 28/28 6 months ago
training_args.bin
5.84 kB
xet

Checkpoint step: 25 | Target words: 1,000,000 | Actual tokens: 1,638,400 | Actual words: 1,002,164.6756995108 | Progress: 1/28 6 months ago