somali-tokenizer / tokenizer.json
sharafdin's picture
Add Somali ByteLevel BPE v2
e7d6827 verified
Raw History Contribute Delete
1.7 MB
File too large to display, you can check the raw version instead.