Commit History
-
Upload tokenizer.json
Verified signature70ef62f
-
Refactor README.md to remove licensing section and unsupported tasks, streamlining content for clarity
2e71ee6 -
Update README.md to change tokenizer model reference and remove licensing, citation, and contribution sections
72772cb -
Add README.md for TR Tokenizer and include usage examples
833de38 -
Upload tokenizer_config.json
Verified signature1a1d524 -
Upload test_bpe_tokenizer.json
Verified signature9d5be2e -
initial commit
Verified signaturee8dea55