da_en_translation / tokenizer_config.json
JBW's picture
Update tokenizer_config.json
2476f71
raw
history blame contribute delete
112 Bytes
{"bos_token": "[BOS]", "eos_token": "[EOS]", "pad_token": "[PAD]", "tokenizer_class": "PreTrainedTokenizerFast"}