flexitok
/

bpe_dan_Latn_8000

Model card Files Files and versions

bpe_dan_Latn_8000 / safe

Ctrl+K

Ctrl+K

1 contributor

History: 6 commits

gsaltintas's picture

Upload safe/flexitok--bpe_dan_Latn_8000_overlap.json with huggingface_hub

1cedae5 verified about 1 month ago

flexitok--bpe_dan_Latn_8000.yaml

78 Bytes
Upload safe/flexitok--bpe_dan_Latn_8000.yaml with huggingface_hub about 1 month ago
flexitok--bpe_dan_Latn_8000_info.json

86 Bytes
Upload safe/flexitok--bpe_dan_Latn_8000_info.json with huggingface_hub about 1 month ago
flexitok--bpe_dan_Latn_8000_overlap.json

2.58 kB
Upload safe/flexitok--bpe_dan_Latn_8000_overlap.json with huggingface_hub about 1 month ago
flexitok--bpe_dan_Latn_8000_super_mapping.json

118 kB
Upload safe/flexitok--bpe_dan_Latn_8000_super_mapping.json with huggingface_hub about 1 month ago
flexitok--bpe_dan_Latn_8000_vocab.json

151 kB
Upload safe/flexitok--bpe_dan_Latn_8000_vocab.json with huggingface_hub about 1 month ago
participating_tokenizers.json

649 Bytes
Upload safe/participating_tokenizers.json with huggingface_hub about 1 month ago