path_to_saved_model / tokenizer /added_tokens.json
Mingfei0830's picture
End of training
78edfaa
raw
history blame contribute delete
57 Bytes
{
"<|endoftext|>": 49407,
"<|startoftext|>": 49406
}