Modelpublic

ljvmiranda921/PolyglotTeachers-Multilingual-Instruct

sourceHugging Faceotherupdated 2mo agoView on Hugging Face

1likes10downloads

Model Card

Website: ljvmiranda921.github.io/polyglot-teachers/

Multilingual Instruct Models (Polyglot Teachers)

These are per-language models supervised fine-tuned on the synthetic data generated in the Polyglot Teachers project (see ljvmiranda921/PolyglotTeachers-SFT-Synth).

Load a specific model by passing the branch as the revision:

python

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "ljvmiranda921/Polyglot-SFT-Multilingual"
branch = "Polyglot-OLMo3-7B-SFT-ar"  # pick any branch below
model = AutoModelForCausalLM.from_pretrained(repo, revision=branch)
tokenizer = AutoTokenizer.from_pretrained(repo, revision=branch)

Branches

Branch	Description
`Polyglot-Gemma3-4B-SFT-ar`	Gemma-3 4B SFT — Arabic
`Polyglot-Gemma3-4B-SFT-de`	Gemma-3 4B SFT — German
`Polyglot-Gemma3-4B-SFT-id`	Gemma-3 4B SFT — Indonesian
`Polyglot-Gemma3-4B-SFT-tl`	Gemma-3 4B SFT — Tagalog
`Polyglot-OLMo3-7B-SFT-ar`	OLMo-3 7B SFT — Arabic
`Polyglot-OLMo3-7B-SFT-cs`	OLMo-3 7B SFT — Czech
`Polyglot-OLMo3-7B-SFT-de`	OLMo-3 7B SFT — German
`Polyglot-OLMo3-7B-SFT-es`	OLMo-3 7B SFT — Spanish
`Polyglot-OLMo3-7B-SFT-id`	OLMo-3 7B SFT — Indonesian
`Polyglot-OLMo3-7B-SFT-ja`	OLMo-3 7B SFT — Japanese

Licensing

This repo holds models under different licenses; each branch follows its base model's license:

—Polyglot-OLMo3-7B-SFT-* (base allenai/Olmo-3-1025-7B) — Apache-2.0
—Polyglot-Gemma3-4B-SFT-* (base google/gemma-3-4b-pt) — Gemma license

Acknowledgements

LJVM and AK acknowledge the support of the UKRI Frontier Grant EP/Y031350/1 (EQUATE). This work was performed using joint resources provided by the Cambridge Service for Data Driven Discovery (CSD3) EP/T022159/1 and the Isambard AI National AI Research Resource (AIRR) ST/AIRR/I-A-I/1023, and the Microsoft Research Grant. LJVM would also like to thank Songbo Hu, Chen Cecilia Liu, Millicent Ochieng, and Felermino Ali for helpful and productive discussions on the project.

Citation

bibtex

@misc{miranda2026polyglotteachersevaluatinglanguage,
    title={Polyglot Teachers: Evaluating Language Models for Multilingual Synthetic Data Generation},
    author={Lester James V. Miranda and Ivan Vulić and Anna Korhonen},
    year={2026},
    eprint={2604.11290},
    archivePrefix={arXiv},
    primaryClass={cs.CL},
    url={https://arxiv.org/abs/2604.11290},
}