deep-encoder-shallow-decoder-en / tokenizer_config.json
snoop2head's picture
add tokenizer
253c6db
raw
history blame
82 Bytes
{"name_or_path": "english-WPE.json", "tokenizer_class": "PreTrainedTokenizerFast"}