5.84 GB

4 contributors

Step... (227000/250000 | Loss: 1.7146042585372925, Acc: 0.6542283296585083): 91%|████████████████████ | 227713/250000 [23:57:48<11:56:53, 1.93s/it]

3d47c9f over 4 years ago

configs
Training dump over 4 years ago
mc4
Step... (186000/250000 | Loss: 1.7381113767623901, Acc: 0.6502522826194763): 74%|█████████████████ | 186090/250000 [2:39:06<32:58:04, 1.86s/it] over 4 years ago
outputs
Step... (227000/250000 | Loss: 1.7146042585372925, Acc: 0.6542283296585083): 91%|████████████████████ | 227713/250000 [23:57:48<11:56:53, 1.93s/it] over 4 years ago
.gitattributes

823 Bytes

Training dump over 4 years ago
.gitignore

38 Bytes

Training dump over 4 years ago
README.md

1.43 kB

Update README.md over 4 years ago
config.json

618 Bytes

PyTorch version 180k steps acc 0.6487 over 4 years ago
convert.py

876 Bytes

PyTorch version 180k steps acc 0.6487 over 4 years ago
flax_model.msgpack

250 MB
xet

Step... (227000/250000 | Loss: 1.7146042585372925, Acc: 0.6542283296585083): 91%|████████████████████ | 227713/250000 [23:57:48<11:56:53, 1.93s/it] over 4 years ago
mc4-es-train-50M-steps-stats.csv.tar.gz

544 MB
xet

Dataset stats over 4 years ago
merges.txt

514 kB

PyTorch version 180k steps acc 0.6487 over 4 years ago
push_to_hub.sh

84 Bytes

Step... (188000/250000 | Loss: 1.7402708530426025, Acc: 0.6501697897911072): 75%|█████████████████▎ | 188213/250000 [3:43:59<31:25:35, 1.83s/it] over 4 years ago
pytorch_model.bin

499 MB
xet

Step... (227000/250000 | Loss: 1.7146042585372925, Acc: 0.6542283296585083): 91%|████████████████████ | 227713/250000 [23:57:48<11:56:53, 1.93s/it] over 4 years ago
run_mlm_flax_stream.py

35.2 kB

Step... (186000/250000 | Loss: 1.7381113767623901, Acc: 0.6502522826194763): 74%|█████████████████ | 186090/250000 [2:39:06<32:58:04, 1.86s/it] over 4 years ago
run_stream.128.sh

1 kB

Step... (186000/250000 | Loss: 1.7381113767623901, Acc: 0.6502522826194763): 74%|█████████████████ | 186090/250000 [2:39:06<32:58:04, 1.86s/it] over 4 years ago
run_stream.512.sh

978 Bytes

Step... (186000/250000 | Loss: 1.7381113767623901, Acc: 0.6502522826194763): 74%|█████████████████ | 186090/250000 [2:39:06<32:58:04, 1.86s/it] over 4 years ago
run_stream.sh

929 Bytes

Training dump over 4 years ago
special_tokens_map.json

239 Bytes

PyTorch version 180k steps acc 0.6487 over 4 years ago
tokenizer.json

1.47 MB

PyTorch version 180k steps acc 0.6487 over 4 years ago
tokenizer_config.json

292 Bytes

PyTorch version 180k steps acc 0.6487 over 4 years ago
vocab.json

855 kB

PyTorch version 180k steps acc 0.6487 over 4 years ago