DatarrX/myX-Tokenizer
Feature Extraction • Updated
myX-Tokenizer Series
A comprehensive collection of syllable-aware tokenizers optimized for Burmese-English NLP tasks, developed by DatarrX.
Note Highly recommended for LLM training
-
DatarrX/myX-Tokenizer-BPE
Feature Extraction • Updated -
DatarrX/myX-Tokenizer-Unigram
Feature Extraction • Updated
kalixlouiis/myX-Corpus
Viewer • Updated • 2.73M • 9Note Official training data for the myX series