7.96 MB

Ctrl+K

7 contributors

History: 64 commits

amank

Minor Code cleanup in utils file

7007f93 over 4 years ago

.vscode
Made change to cleaning code, modified number of warmpu step, getting eval samples from validation split over 4 years ago
roberta_mc4_sentence_piece
Updated code to work with streaming version over 4 years ago
.gitattributes

737 Bytes
Saving weights and logs of epoch 2 over 4 years ago
.gitignore

43 Bytes
Made change to cleaning code, modified number of warmpu step, getting eval samples from validation split over 4 years ago
README.md

6.79 kB
Update README.md over 4 years ago
config.json

692 Bytes
mc4 epoch14 exported torch config & tokenizer over 4 years ago
create_config.py

147 Bytes
All set to train over 4 years ago
flax_to_torch.py

793 Bytes
Convert latest model to PyTorch over 4 years ago
merges.txt

1.21 MB
Pytorch export fix over 4 years ago
run.sh

562 Bytes
Updated code to have different seed and reduced lr over 4 years ago
run_mlm_flax.py

30.6 kB
Updated code to work with streaming version over 4 years ago
run_mlm_flax_old.py

28.7 kB
Updated code to work with streaming version over 4 years ago
run_mlm_flax_stream.py

27.5 kB
Made change to cleaning code, modified number of warmpu step, getting eval samples from validation split over 4 years ago
run_stream.sh

673 Bytes
Made change to cleaning code, modified number of warmpu step, getting eval samples from validation split over 4 years ago
special_tokens_map.json

239 Bytes
Pytorch export fix over 4 years ago
tokenizer.json

2.86 MB
mc4 epoch14 exported torch config & tokenizer over 4 years ago
tokenizer_config.json

279 Bytes
Pytorch export fix over 4 years ago
train_tokenizer.py

1.08 kB
Updated code to work with streaming version over 4 years ago
utils.py

1.75 kB
Minor Code cleanup in utils file over 4 years ago
vocab.json

1.55 MB
Pytorch export fix over 4 years ago