ace-1
/

mgpt2-tokenizer

Model card Files Files and versions

mgpt2-tokenizer / tokenization_mgpt2.py

Commit History

Publish mgpt2 tokenizer (GPT-2 exact merges) + eval metrics

24cf5c6
verified

ace-1 commited on 9 days ago