SaulLu's picture
add tokenizer example with model config
8a27784
raw
history blame contribute delete
73 Bytes
{ "model_type": "albert", "tokenizer_class": "PreTrainedTokenizerFast" }