flexitok
/

supertokenizer-mod_tokenizers

Model card Files Files and versions

supertokenizer-mod_tokenizers / config.yaml

gsaltintas's picture

Upload config.yaml with huggingface_hub

a0fe286 verified 3 days ago

history blame contribute delete

28 Bytes

	model:
	vocab_size: 100007