rahular
/

oeullm_tok

Model card Files Files and versions

oeullm_tok / README.md

rahular's picture

Update README.md

b94c137 verified 3 months ago

|

history blame contribute delete

147 Bytes

	---
	library_name: transformers
	tags: []
	---

	OELLM SPM Tokenizer with 128K tokens. It is trained with a config similar to that of `GemmaTokenizer`.