Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
tspersian
/
mana_tokenizer
like
0
Persian
English
Arabic
License:
mit
Model card
Files
Files and versions
xet
Community
d786ff1
mana_tokenizer
14.1 MB
Ctrl+K
Ctrl+K
1 contributor
History:
10 commits
tspersian
package
d786ff1
over 1 year ago
.gitattributes
Safe
88 Bytes
Re-add model and vocab files with LFS
over 1 year ago
.gitignore
Safe
13 Bytes
package
over 1 year ago
README.md
Safe
1.84 kB
package
over 1 year ago
__init__.py
Safe
133 Bytes
package
over 1 year ago
base.py
Safe
14.6 kB
package
over 1 year ago
helper.py
Safe
3.27 kB
scripts
over 1 year ago
mana.model
2.92 MB
xet
Updated files and statistics.
over 1 year ago
mana.vocab
Safe
11.1 MB
xet
Updated files and statistics.
over 1 year ago
mana_tokenizer.py
3.55 kB
package
over 1 year ago
test.py
Safe
229 Bytes
package
over 1 year ago