clvp_dev / tokenizer_config.json

Commit History

change model_max_length to 402.
5dee0e6

susnato commited on

make add_bos_token and add_eos_token to false
8c4da86

susnato commited on

Uploaded new saved tokenizer
75a9688

susnato commited on