Nexuss0781
/

Ethio-BBPE

Model card Files Files and versions

Ethio-BBPE / scripts /train_tokenizer.py

Commit History

Upload scripts/train_tokenizer.py with huggingface_hub

80f2516
verified

Nexuss0781 commited on May 1

Upload scripts/train_tokenizer.py with huggingface_hub

bbb716d
verified

Nexuss0781 commited on May 1

feat: Initial release of EthioBBPE - Ethiopian Language Tokenizer

d681ea8
verified

Nexuss0781 commited on May 1