AkieTokenizer / tokenizer_config.json

Commit History

Publica AkieTokenizer (SentencePiece 32k)
d08611a
verified

IuriCerqueira commited on