dna_tokens / tokenizer_config.json
ad3002's picture
add tokens
04d2713
raw
history blame contribute delete
47 Bytes
{"tokenizer_class": "PreTrainedTokenizerFast"}