GursimranSinghBasra
/

akshara-tokenizer

Model card Files Files and versions

akshara-tokenizer

Ctrl+K

Ctrl+K

1 contributor

History: 5 commits

GursimranSinghBasra's picture

GursimranSinghBasra

Card: correct vocabulary share to 92.25 percent, add arm N result

3fcfcc3 verified 3 days ago

.gitattributes

1.52 kB
initial commit 18 days ago
CITATION.cff

320 Bytes
Add v1.2 model and map; update model card and CITATION to 1.2.0 15 days ago
LICENSE

10.9 kB
Add AksharaTokenizer v1.1 model, vocab, model card, license, citation 18 days ago
NOTICE

271 Bytes
Add AksharaTokenizer v1.1 model, vocab, model card, license, citation 18 days ago
README.md

11.4 kB
Card: correct vocabulary share to 92.25 percent, add arm N result 3 days ago
akshara_tokenizer_v1_1.model

563 kB
xet

Add AksharaTokenizer v1.1 model, vocab, model card, license, citation 18 days ago
akshara_tokenizer_v1_1.vocab

334 kB
Add AksharaTokenizer v1.1 model, vocab, model card, license, citation 18 days ago
akshara_tokenizer_v1_2.map.json

351 kB
Add v1.2 model and map; update model card and CITATION to 1.2.0 15 days ago
akshara_tokenizer_v1_2.model

1.22 MB
xet

Add v1.2 model and map; update model card and CITATION to 1.2.0 15 days ago