absa_llama / added_tokens.json
SilvioLima's picture
Upload tokenizer
b8a9cf1 verified
raw
history blame contribute delete
39 Bytes
{
"<pad>": 32001,
"<sep>": 32000
}