datause-extraction-v8 / added_tokens.json
rafmacalaba's picture
all manual and reviewed with hard negatives
0d7b188 verified
{
"<<ENT>>": 128002,
"<<SEP>>": 128003,
"[FLERT]": 128001,
"[MASK]": 128000
}