Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
DatarrX
/
myX-Tokenizer
like
4
Follow
DatarrX
15
Feature Extraction
9 datasets
Burmese
English
Pāli
sentencepiece
tokenizer
unigram
myanmar
burmese
nlp
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
myX-Tokenizer
Commit History
Update README.md
c4320d9
verified
kalixlouiis
commited on
May 1
Update README.md
afcaac7
verified
kalixlouiis
commited on
May 1
Upload benchmark.png
d2d25cd
verified
kalixlouiis
commited on
May 1
Upload 2 files
d5d8899
verified
kalixlouiis
commited on
Mar 31
Delete tokenizer.vocab
9a5f830
verified
kalixlouiis
commited on
Mar 31
Delete tokenizer.model
bdc98bf
verified
kalixlouiis
commited on
Mar 31
Upload 2 files
4c1efa0
verified
kalixlouiis
commited on
Mar 27
Delete tokenizer.vocab
786a0dc
verified
kalixlouiis
commited on
Mar 27
Delete tokenizer.model
1b2b6ba
verified
kalixlouiis
commited on
Mar 27
Update README.md
ddb03f8
verified
kalixlouiis
commited on
Mar 27
Delete myX-Tokenizer.vocab
776dc65
verified
kalixlouiis
commited on
Mar 27
Delete myX-Tokenizer.model
29cd768
verified
kalixlouiis
commited on
Mar 27
Upload tokenizer.vocab with huggingface_hub
6e4c2a6
verified
kalixlouiis
commited on
Mar 27
Upload tokenizer.model with huggingface_hub
95dc819
verified
kalixlouiis
commited on
Mar 27
Update README.md
444c401
verified
kalixlouiis
commited on
Feb 26
Upload 2 files
703cfa0
verified
kalixlouiis
commited on
Feb 26
initial commit
586a4ed
verified
kalixlouiis
commited on
Feb 26