7e4a223 b94c137
1
2
3
4
5
6
--- library_name: transformers tags: [] --- OELLM SPM Tokenizer with 128K tokens. It is trained with a config similar to that of `GemmaTokenizer`.