Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
babylm-seqlen
/
opt-8192-warmup-v2
like
0
Follow
BabyLM Sequence Length
4
Safetensors
opt
Model card
Files
Files and versions
xet
Community
main
opt-8192-warmup-v2
520 MB
Ctrl+K
Ctrl+K
1 contributor
History:
29 commits
rdiehlmartinez
Checkpoint step: 3,100 | Target words: 1,000,000,000 | Actual tokens: 1,625,292,800 | Actual words: 1,000,000,000.0 | Progress: 28/28
94e6f5f
verified
9 months ago
.gitattributes
Safe
1.52 kB
initial commit
9 months ago
config.json
Safe
658 Bytes
Checkpoint step: 4 | Target words: 1,000,000 | Actual tokens: 2,097,152 | Actual words: 1,290,322.5806451612 | Progress: 1/28
9 months ago
model.safetensors
520 MB
xet
Checkpoint step: 3,100 | Target words: 1,000,000,000 | Actual tokens: 1,625,292,800 | Actual words: 1,000,000,000.0 | Progress: 28/28
9 months ago
training_args.bin
pickle
Detected Pickle imports (10)
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"transformers.trainer_utils.SchedulerType"
,
"transformers.trainer_utils.HubStrategy"
,
"torch.device"
,
"transformers.trainer_utils.IntervalStrategy"
,
"transformers.training_args.TrainingArguments"
,
"accelerate.state.PartialState"
,
"transformers.trainer_utils.SaveStrategy"
,
"transformers.training_args.OptimizerNames"
,
"accelerate.utils.dataclasses.DistributedType"
How to fix it?
5.84 kB
xet
Checkpoint step: 4 | Target words: 1,000,000 | Actual tokens: 2,097,152 | Actual words: 1,290,322.5806451612 | Progress: 1/28
9 months ago
