QuoteGen / added_tokens.json
krohak's picture
Upload tokenizer
594bd1c
raw
history blame contribute delete
57 Bytes
{
"<BOS>": 50257,
"<EOS>": 50258,
"<PAD>": 50259
}