instanton-baseline / tokenizer_config.json

Commit History

Fix eval-env tokenizer loading: set add_prefix_space=true in tokenizer_config.json (transformers 4.x ignores it in tokenizer.json)
fbf7815
verified

qyxu1994 commited on

final model
5ec8436
verified

qyxu1994 commited on