ljvmiranda921/Polyglot-SFT-Multilingual

Multilingual Instruct Models (Polyglot Teachers)

These are per-language models supervised fine-tuned on the synthetic data generated in the Polyglot Teachers project (see ljvmiranda921/PolyglotTeachers-SFT-Synth).

Load a specific model by passing the branch as the revision:

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "ljvmiranda921/Polyglot-SFT-Multilingual"
branch = "Polyglot-OLMo3-7B-SFT-ar"  # pick any branch below
model = AutoModelForCausalLM.from_pretrained(repo, revision=branch)
tokenizer = AutoTokenizer.from_pretrained(repo, revision=branch)

Branches

Branch	Description
Polyglot-Gemma3-4B-SFT-ar	Gemma-3 4B SFT — Arabic
Polyglot-Gemma3-4B-SFT-de	Gemma-3 4B SFT — German
Polyglot-Gemma3-4B-SFT-id	Gemma-3 4B SFT — Indonesian
Polyglot-Gemma3-4B-SFT-tl	Gemma-3 4B SFT — Tagalog
Polyglot-OLMo3-7B-SFT-ar	OLMo-3 7B SFT — Arabic
Polyglot-OLMo3-7B-SFT-cs	OLMo-3 7B SFT — Czech
Polyglot-OLMo3-7B-SFT-de	OLMo-3 7B SFT — German
Polyglot-OLMo3-7B-SFT-es	OLMo-3 7B SFT — Spanish
Polyglot-OLMo3-7B-SFT-id	OLMo-3 7B SFT — Indonesian
Polyglot-OLMo3-7B-SFT-ja	OLMo-3 7B SFT — Japanese

Licensing

This repo holds models under different licenses; each branch follows its base model's license:

• Polyglot-OLMo3-7B-SFT-* (base allenai/Olmo-3-1025-7B) — Apache-2.0
• Polyglot-Gemma3-4B-SFT-* (base google/gemma-3-4b-pt) — Gemma license

Acknowledgements

LJVM and AK acknowledge the support of the UKRI Frontier Grant EP/Y031350/1 (EQUATE). This work was performed using joint resources provided by the Cambridge Service for Data Driven Discovery (CSD3) EP/T022159/1 and the Isambard AI National AI Research Resource (AIRR) ST/AIRR/I-A-I/1023, and the Microsoft Research Grant. LJVM would also like to thank Songbo Hu, Chen Cecilia Liu, Millicent Ochieng, and Felermino Ali for helpful and productive discussions on the project.

Citation

@misc{miranda2026polyglotteachersevaluatinglanguage,
    title={Polyglot Teachers: Evaluating Language Models for Multilingual Synthetic Data Generation},
    author={Lester James V. Miranda and Ivan Vulić and Anna Korhonen},
    year={2026},
    eprint={2604.11290},
    archivePrefix={arXiv},
    primaryClass={cs.CL},
    url={https://arxiv.org/abs/2604.11290},
}