rahular
/

oeullm_tok

Model card Files Files and versions

oeullm_tok / README.md

rahular's picture

Update README.md

b94c137 verified 3 months ago

|

history blame contribute delete

147 Bytes

library_name: transformers
tags: []

OELLM SPM Tokenizer with 128K tokens. It is trained with a config similar to that of GemmaTokenizer.