omni / src /trainers /lm /train_tokenizer.py

Commit History

refactor: reorganize dataset into lm/vlm/vam subdirectories
d9f29d1

chenbhao Claude Opus 4.6 commited on

Add tokenizer training script and save trained tokenizer into checkpoint dir
1909c9c

chenbhao commited on

Flatten src layout: drop omni namespace, modules live directly under src/
92c7321

chenbhao commited on