Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
transhumanist-already-exists
/
ayayay-tokenizer
like
5
Transformers
lang-uk/malyuk
QIRIM/crh_monocorpus
24 languages
aya-tokenizer
ukraine
corpus-linguistics
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
ayayay-tokenizer
54.4 MB
1 contributor
History:
14 commits
transhumanist-already-exists
Update README.md
5cb49d2
verified
9 months ago
.gitattributes
1.74 kB
add img
9 months ago
README.md
11.8 kB
Update README.md
9 months ago
ayayay.png
2.11 MB
xet
add img
9 months ago
malyuk_qirim_tokenizer.json
23.5 MB
xet
Upload malyuk_qirim_tokenizer.json
9 months ago
merge_info.json
2.74 MB
add tokenizer files
9 months ago
special_tokens_map.json
439 Bytes
add tokenizer files
9 months ago
tokenizer.json
14.5 MB
xet
add tokenizer files
9 months ago
tokenizer_config.json
8.64 kB
add tokenizer files
9 months ago
tokenizer_utf8.json
11.5 MB
xet
add tokenizer files
9 months ago
