zenith / tokenizer_config.json
Mohad1224's picture
Upload folder using huggingface_hub
66b099c verified
{"tokenizer_type": "custom", "vocab_size": 100}