AuroraGPT-O2-FRG / added_tokens.json
Stevens's picture
Upload tokenizer
90891a6 verified
raw
history blame contribute delete
49 Bytes
{
"<pad>": 32000,
"<|end_of_text|>": 32001
}