File size: 147 Bytes
7e4a223
 
 
 
 
b94c137
1
2
3
4
5
6
---
library_name: transformers
tags: []
---

OELLM SPM Tokenizer with 128K tokens. It is trained with a config similar to that of `GemmaTokenizer`.