shridhar_8k / added_tokens.json
nativemind's picture
Upload tokenizer
b5c1bcf verified
raw
history blame contribute delete
29 Bytes
{
"<|endoftext|>": 50257
}