GPT2-SCP-Miscellaneous / added_tokens.json
Azaghast's picture
add tokenizer
e6c1d52
raw
history blame
48 Bytes
{"[BOS]": 50257, "[EOS]": 50258, "[PAD]": 50259}