aakashMeghwar01
/

SindhiLM-Tokenizer-v1

morphology-aware

low-resource-nlp

Model card Files Files and versions

SindhiLM-Tokenizer-v1

Commit History

Upgraded architecture: Unigram + Metaspace fix + 32k Vocab limit + Morpheme splitting

be8d37f
verified

aakashMeghwar01 commited on Mar 16

Update README.md

86da236
verified

aakashMeghwar01 commited on Mar 15

Upgraded architecture: Unigram + Metaspace fix + 32k Vocab limit + Morpheme splitting

f82968f
verified

aakashMeghwar01 commited on Mar 15

Update README.md

bdffe7e
verified

aakashMeghwar01 commited on Mar 15

Upload sindhi_bpe_v1.json with huggingface_hub

df2a177
verified

aakashMeghwar01 commited on Mar 15

Upload tokenizer

619611c
verified

aakashMeghwar01 commited on Mar 15

Upload sindhi_bpe_v2.json with huggingface_hub

ef75092
verified

aakashMeghwar01 commited on Mar 15

Upload tokenizer

f397ed2
verified

aakashMeghwar01 commited on Mar 15

initial commit

993391c
verified

aakashMeghwar01 commited on Mar 15