File size: 3,385 Bytes
0b07581 4fbfa19 0b07581 4d1899e 85c1132 4d1899e 85c1132 0b07581 34b08a1 0b07581 4fbfa19 0b07581 4fbfa19 0b07581 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 | ---
library_name: transformers
license: other
license_name: mixed
pipeline_tag: text-generation
language:
- ar
- es
- cs
- de
- id
- tl
- ja
base_model:
- allenai/Olmo-3-1025-7B
- google/gemma-3-4b-pt
datasets:
- ljvmiranda921/PolyglotTeachers-SFT-Synth
tags:
- multilingual
- synthetic
- sft
---
<div style="display: flex; align-items: center; gap: 20px;">
<img alt="Logo for UCam" src="cambridge_logo.png" style="height: 80px; width: auto;">
<img alt="Logo for LTL" src="ltl_logo2.svg" style="height: 80px; width: auto;">
</div>
# Multilingual Instruct Models (Polyglot Teachers)
These are per-language models supervised fine-tuned on the synthetic data
generated in the [Polyglot Teachers](https://huggingface.co/papers/2604.11290)
project (see [ljvmiranda921/PolyglotTeachers-SFT-Synth](https://huggingface.co/datasets/ljvmiranda921/PolyglotTeachers-SFT-Synth)).
Load a specific model by passing the branch as the `revision`:
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "ljvmiranda921/Polyglot-SFT-Multilingual"
branch = "Polyglot-OLMo3-7B-SFT-ar" # pick any branch below
model = AutoModelForCausalLM.from_pretrained(repo, revision=branch)
tokenizer = AutoTokenizer.from_pretrained(repo, revision=branch)
```
## Branches
| Branch | Description |
| --- | --- |
| `Polyglot-Gemma3-4B-SFT-ar` | Gemma-3 4B SFT โ Arabic |
| `Polyglot-Gemma3-4B-SFT-de` | Gemma-3 4B SFT โ German |
| `Polyglot-Gemma3-4B-SFT-id` | Gemma-3 4B SFT โ Indonesian |
| `Polyglot-Gemma3-4B-SFT-tl` | Gemma-3 4B SFT โ Tagalog |
| `Polyglot-OLMo3-7B-SFT-ar` | OLMo-3 7B SFT โ Arabic |
| `Polyglot-OLMo3-7B-SFT-cs` | OLMo-3 7B SFT โ Czech |
| `Polyglot-OLMo3-7B-SFT-de` | OLMo-3 7B SFT โ German |
| `Polyglot-OLMo3-7B-SFT-es` | OLMo-3 7B SFT โ Spanish |
| `Polyglot-OLMo3-7B-SFT-id` | OLMo-3 7B SFT โ Indonesian |
| `Polyglot-OLMo3-7B-SFT-ja` | OLMo-3 7B SFT โ Japanese |
## Licensing
This repo holds models under different licenses; each branch follows its base
model's license:
- `Polyglot-OLMo3-7B-SFT-*` (base [allenai/Olmo-3-1025-7B](https://huggingface.co/allenai/Olmo-3-1025-7B)) โ Apache-2.0
- `Polyglot-Gemma3-4B-SFT-*` (base [google/gemma-3-4b-pt](https://huggingface.co/google/gemma-3-4b-pt)) โ [Gemma license](https://ai.google.dev/gemma/terms)
## Acknowledgements
LJVM and AK acknowledge the support of the UKRI Frontier Grant EP/Y031350/1 ([EQUATE](https://gtr.ukri.org/projects?ref=EP%2FY031350%2F1)).
This work was performed using joint resources provided by the [Cambridge Service for Data Driven Discovery (CSD3)](https://hpc.cam.ac.uk/high-performance-computing) EP/T022159/1 and the [Isambard AI National AI Research Resource (AIRR)](https://www.bristol.ac.uk/research/centres/bristol-supercomputing/#isambard-ai) ST/AIRR/I-A-I/1023, and the Microsoft Research Grant.
LJVM would also like to thank Songbo Hu, Chen Cecilia Liu, Millicent Ochieng, and Felermino Ali for helpful and productive discussions on the project.
## Citation
```bibtex
@misc{miranda2026polyglotteachersevaluatinglanguage,
title={Polyglot Teachers: Evaluating Language Models for Multilingual Synthetic Data Generation},
author={Lester James V. Miranda and Ivan Vuliฤ and Anna Korhonen},
year={2026},
eprint={2604.11290},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2604.11290},
}
```
|