dom-tokenizer-10k / tokenizer_config.json

Commit History

Increase model_max_length
c90d668

gbenson commited on

Switch to cased base model
85a0b70

gbenson commited on

Configure [BOS] and [EOS] properly
7bc4f29

gbenson commited on

Upload folder using huggingface_hub
e9fd7a4
verified

gbenson commited on