flexitok
/

supertokenizer-mod_tokenizers

Model card Files Files and versions

gsaltintas commited on Mar 1

Commit

a0fe286

·

verified ·

1 Parent(s): e11f510

Upload config.yaml with huggingface_hub

Files changed (1) hide show

config.yaml +2 -0

config.yaml ADDED Viewed

	@@ -0,0 +1,2 @@


1	+ model:
2	+ vocab_size: 100007