How cani use this tokenizer ？
#2
by
reflexclue
- opened
CAN i use this tokenizer like others？And can i use the output as the model‘s input of Higpt directly？
CAN i use this tokenizer like others？And can i use the output as the model‘s input of Higpt directly？