mactest / vocab.json
web2savar's picture
Upload tokenizer
e3db908 verified
{
"[PAD]": 5,
"[UNK]": 4,
"|": 0,
"â": 1,
"û": 2,
"̇": 3
}