zero-shot-explicit-gpt2 / added_tokens.json
StefanH's picture
add tokenizer
3e1f999
raw
history blame contribute delete
171 Bytes
{"[eot]": 50258, "<|question|>": 50259, "[QUES]": 50263, "<|text|>": 50260, "<|answer|>": 50261, "[ANSW]": 50265, "[PAD]": 50257, "[TEXT]": 50264, "<|answer_sep|>": 50262}