Neobe/dhivehi-en-mt5-large-sentence

mT5-large Dhivehi→English (sentence-level)

mT5-large (1.2B, encoder-decoder) for Dhivehi→English translation, trained on a sentence-level Dhivehi–English corpus (machine-translated).

Sentence-level variant. For multi-sentence input, see the paragraph models: Qwen-para / mT5-para. Suited for single-sentence input.

Scores (chrF / chrF++ / BLEU)

Benchmark	chrF	chrF++	BLEU
gold (human references, article-level, N=500)	53.67	50.01	13.91
held-out chunk (in-distribution)	66.33	64.53	40.76
held-out sentence (in-distribution)	63.94	62.15	39.45

chrF is the metric to trust for Thaana; BLEU is unreliable (word segmentation / morphology).

Example

Input (dv): އެއީ، މިދިޔަ އަހަރުގެ މި މުއްދަތާ ބަލާއިރު، 7.6 އިންސައްތައިގެ ކުރިއެރުމެއް ކަމަށްވާއިރު، ދުވާލަކަށް 7،778 ފަތުރުވެރިން ރާއްޖެ ޒިޔާރަތްކުރެއެވެ.

Output (en): That is, while there is an increase of 7.6 percent compared to the same period last year, 7,778 tourists visit the Maldives per day.

Real held-out sample and this model's own output.

Usage

import torch
from transformers import AutoModelForSeq2SeqLM, AutoTokenizer

m = "Neobe/dhivehi-en-mt5-large-sentence"
tok = AutoTokenizer.from_pretrained(m)
model = AutoModelForSeq2SeqLM.from_pretrained(m, torch_dtype=torch.float32).eval().cuda()  # fp32

src = "ދިވެހިރާއްޖޭގެ ރައީސް މިއަދު ކެބިނެޓާ ބައްދަލުކުރެއްވި އެވެ."
inp = tok(src, return_tensors="pt", truncation=True, max_length=1024).to("cuda")
out = model.generate(**inp, max_new_tokens=256, num_beams=4)
print(tok.decode(out[0], skip_special_tokens=True))

Run in fp32 — the T5 family produces garbage in bf16/fp16. ~5–6 GB VRAM.

Training

Base google/mt5-large; fp32; Adafactor; LR 1e-4 cosine; max_length 512; 1 epoch; effective batch ~32; gradient checkpointing.

Limitations

Domain = Maldivian news / press / Wikipedia; technical or informal English is out of distribution. Non-human references are machine-generated (distillation).

Citation

@misc{neobe_dhivehi_en_mt5_large_sentence_2026,
  title  = {mT5-large Dhivehi→English (sentence-level)},
  author = {Neobe},
  year   = {2026},
  howpublished = {\url{https://huggingface.co/Neobe/dhivehi-en-mt5-large-sentence}}
}