py38-pylingual-v1-tokenizer / tokenizer.json

Commit History

Trained tokenizer using syssec-utd/segmentation-py38-pylingual-v1
fac69d0
verified

lc10934 commited on

Trained tokenizer using syssec-utd/segmentation-py38-pylingual-v1
7ce49e8
verified

lc10934 commited on