PyLoomer_CodeParrot / added_tokens.json
anujsahani01's picture
Training in progress, step 500
f73fb5e
raw
history blame
254 Bytes
{
"<ASSISTANT_TASK:>": 32771,
"<END_TASK>": 32772,
"<SYSTEM_TASK:>": 32769,
"<USER_TASK:>": 32770,
"<|PAD|>": 32768,
"additional_special_tokens": 32777,
"bos_token": 32773,
"eos_token": 32774,
"pad_token": 32776,
"unk_token": 32775
}