Trained tokenizer using syssec-utd/segmentation-py36-pylingual-v1

8a4d92a

verified

lc10934 commited on Feb 4, 2025