ConlangRL - a small transformer that speaks Toki Pona
FLAN-T5-small fine-tuned to translate English <-> Toki Pona and generate simple sentences. Trained entirely on synthetic data built from the complete 136-word dictionary, plus a private set of toki pona songs that shaped its poetic register. 97% exact match on held-out sentence translation.
Prompt formats (plain text2text):
Translate to Toki Pona: the sky is green
Translate from Toki Pona to English: mi moku ala
Generate a Toki Pona sentence about water.
Use beam search (num_beams=4) for translation. Code and the data pipeline live in the ConlangRL repo.
- Downloads last month
- 44