zero-shot-implicit-gpt2 / added_tokens.json
StefanH's picture
add tokenizer
e398c3a
raw
history blame
194 Bytes
{"[PAD]": 50257, "[QUES]": 50262, "<|text|>": 50259, "[eot]": 50265, "<|question|>": 50258, "[ASPECT_SEP]": 50266, "[TEXT]": 50263, "<|answer_sep|>": 50261, "[ANSW]": 50264, "<|answer|>": 50260}