est-roberta / tokenizer_config.json

Commit History

Fixed the tokenizer configuration to get it working with Transformers v5
a546f91
verified

sorasmaa commited on

Added fast tokenizer
5b36f40

matejulcar commited on