VoxCPM2 / tokenization_voxcpm2.py

Commit History

fix: use hasattr for BatchEncoding compatibility
a9d2a4d
verified

linyueqian commited on

feat: add custom tokenizer with multi-char Chinese token splitting
3690391
verified

linyueqian commited on