Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Remeinium
/
WWHO
like
0
Follow
Remeinium AI
1
Feature Extraction
Transformers
Remeinium/WWHO_30m
Sinhala
Hindi
English
tokenizer
WWHO
SGPE
linguis_trie
token
tokenization
Syllable
remeinium
transformer
linguistics
NLP
sinhala
hindi
english
BPE
GPE
Eval Results (legacy)
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
WWHO
/
encoder.py
Commit History
Seperate Before you Compress
e51bea7
thekusaldarshana
commited on
11 days ago
WWHO
e59ea28
thekusaldarshana
commited on
13 days ago
WWHO
fa9c240
thekusaldarshana
commited on
17 days ago
Syllable is the Token
89fc0dc
verified
thekusaldarshana
commited on
23 days ago
thekusaldarshana commited on
