babylm-seqlen
/

opt-8192-warmup-v2

Model card Files Files and versions

opt-8192-warmup-v2

520 MB

1 contributor

History: 29 commits

rdiehlmartinez's picture

Checkpoint step: 3,100 | Target words: 1,000,000,000 | Actual tokens: 1,625,292,800 | Actual words: 1,000,000,000.0 | Progress: 28/28

94e6f5f verified 6 months ago

.gitattributes
1.52 kB

initial commit 6 months ago
config.json
658 Bytes

Checkpoint step: 4 | Target words: 1,000,000 | Actual tokens: 2,097,152 | Actual words: 1,290,322.5806451612 | Progress: 1/28 6 months ago
model.safetensors
520 MB
xet

Checkpoint step: 3,100 | Target words: 1,000,000,000 | Actual tokens: 1,625,292,800 | Actual words: 1,000,000,000.0 | Progress: 28/28 6 months ago
training_args.bin
5.84 kB
xet

Checkpoint step: 4 | Target words: 1,000,000 | Actual tokens: 2,097,152 | Actual words: 1,290,322.5806451612 | Progress: 1/28 6 months ago