anlp-a2-part1-mlp

Decoder-only transformer trained from scratch to translate Vietnamese and Japanese to English (belumind/en-vi-ja-curated-500k-triplets). FFN variant: mlp.

• total params: 17,011,584 | active params per token: 17,011,584
• trained on 39,003,133 tokens
• W&B run: https://wandb.ai/dunkronit-iiit-hyderabad/anlp-a2-part1/runs/mlp-d97442fc

Input format: <vi> source <en> or <ja> source <en>; the model continues with English and <eos>. Load with src.part1.model.Transformer.from_pretrained("DunkRonit/anlp-a2-part1-mlp") from the assignment repo.