astroBERT / tokenizer_config.json

Commit History

Remove ` "add_special_tokens"` tokenizer config key (#2)
b692b96
verified

jcrpaquin-cfa commited on

tokenizer max len and NER labels added
fdbc193

fgrezes commited on

astroBERT tokenizer nsp+mlm chkp 10350000
99bf156

fgrezes commited on