babylm-seqlen
/

opt-4096-warmup-v2

Model card Files Files and versions

opt-4096-warmup-v2

507 MB

1 contributor

History: 29 commits

rdiehlmartinez's picture

Checkpoint step: 6,220 | Target words: 1,000,000,000 | Actual tokens: 1,630,535,680 | Actual words: 1,000,000,000.0 | Progress: 28/28

397367e verified 6 months ago

.gitattributes
1.52 kB

initial commit 6 months ago
config.json
658 Bytes

Checkpoint step: 7 | Target words: 1,000,000 | Actual tokens: 1,835,008 | Actual words: 1,125,401.9292604502 | Progress: 1/28 6 months ago
model.safetensors
507 MB
xet

Checkpoint step: 6,220 | Target words: 1,000,000,000 | Actual tokens: 1,630,535,680 | Actual words: 1,000,000,000.0 | Progress: 28/28 6 months ago
training_args.bin
5.84 kB
xet

Checkpoint step: 7 | Target words: 1,000,000 | Actual tokens: 1,835,008 | Actual words: 1,125,401.9292604502 | Progress: 1/28 6 months ago