e5-base-v2 / tokenizer.tkz

Commit History

Update tokenizer.tkz to v11 (with pad_token_id)
b67a7fb
verified

bhavnicksm commited on