gte-small / tokenizer.tkz

Commit History

Update tokenizer.tkz to v11 (with pad_token_id)
0af8996
verified

bhavnicksm commited on