Commit History
-
Revert back to NFD tokenizer
Verified signature3341d84 -
Remove normalizer
Verified signature767e594 -
Switch from NFD -> NFC
Verified signature0dcea10
-
Update README.md
Verified signature6d5f592 -
Upload tokenizer
Verified signature57dcf89
-
initial commit
Verified signature74fae32