Ethosoft-Math-Translator / special_tokens_map.json
Ekrem-the-second's picture
Ethosoft-Math-Translator v1: symbol-preserving EN->TR math translation (fine-tuned NedoTranslator)
a3f4427 verified
Raw History Blame Contribute Delete
74 Bytes
{
"eos_token": "</s>",
"pad_token": "<pad>",
"unk_token": "<unk>"
}