Hugging Face's logo

flexitok
/
bpe_script_Germ_32000

tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_script_Germ_32000 / script_1 /flexitok--bpe_script_Germ_32000.yaml
gsaltintas's picture
gsaltintas
Upload script_1/flexitok--bpe_script_Germ_32000.yaml with huggingface_hub
6c75fb2 verified
raw
history blame contribute delete
82 Bytes
data:
 tokenizer:
 name: huggingface
 path: flexitok/bpe_script_Germ_32000