Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
fzengin18
/
multrenizer
like
0
Transformers
wikimedia/wikipedia
Helsinki-NLP/opus-100
Turkish
English
tokenizer
tokenizers
unigram
turkish
english
bilingual
arxiv:
2508.08424
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
multrenizer
/
tokenizer_config.json
Commit History
Upload folder using huggingface_hub
8306520
verified
fzengin18
commited on
1 day ago