phi3_unlearned_2 / tokenizer_config.json
MinaMila's picture
Upload tokenizer_config.json with huggingface_hub
f52ea09 verified
raw
history blame contribute delete
110 Bytes
{
"tokenizer_class": "PhiTokenizer",
"auto_map": {
"AutoTokenizer": "transformers.PhiTokenizer"
}
}