PyLoomer_CodeParrot / added_tokens.json
anujsahani01's picture
Training in progress, step 500
aef67f7
raw
history blame
272 Bytes
{
"<ASSISTANT_TASK:>": 32771,
"<END_TASK>": 32772,
"<PAD>": 32773,
"<SYSTEM_TASK:>": 32769,
"<USER_TASK:>": 32770,
"<|PAD|>": 32768,
"additional_special_tokens": 32778,
"bos_token": 32774,
"eos_token": 32775,
"pad_token": 32777,
"unk_token": 32776
}