Fill-Mask
Transformers
Safetensors
Sinhala
mt5
text2text-generation
trimmed
mt5-base-sin-16384 / tokenizer_config.json
lbourdois's picture
Trimmed google/mt5-base for Sinhala (16384 tokens)
584a20c verified
Raw
History Blame Contribute Delete
96 Bytes
{
"eos_token": "</s>",
"unk_token": "<unk>",
"pad_token": "<pad>",
"extra_ids": 0
}