Fill-Mask
Transformers
Safetensors
Sinhala
mt5
text2text-generation
trimmed
mt5-base-sin-32768 / tokenizer_config.json
lbourdois's picture
Trimmed google/mt5-base for Sinhala (32768 tokens)
9c9c297 verified
Raw
History Blame Contribute Delete
96 Bytes
{
"eos_token": "</s>",
"unk_token": "<unk>",
"pad_token": "<pad>",
"extra_ids": 0
}