Modelpublic

byumatrixlab/mapudungun-nllb-600M-es-arn-optuna-bpe

sourceHugging Facecc-by-4.0updated 4mo agoView on Hugging Face

0likes8downloads

Model Card

mapudungun-nllb-600M-es-arn-optuna-bpe

Fine-tuned NLLB-200 distilled 600M for Spanish→Mapudungun translation using the Optuna BPE tokenization condition.

Monolingual BPE with vocabulary size tuned via Optuna hyperparameter search.

Part of the paper: Bringing Mapudungun into the Modern MT Ecosystem: Morphology-Aware Tokenization for NLLB-200 Fine-Tuning (AmericasNLP 2026 @ ACL).

Usage

python

from transformers import pipeline

pipe = pipeline(
    "translation",
    model="byumatrixlab/mapudungun-nllb-600M-es-arn-optuna-bpe",
    src_lang="spa_Latn",
    tgt_lang="arn_Latn",
)
print(pipe("your text here", max_length=256))

Citation

bibtex

@inproceedings{thompson2026mapudungun,
  title     = {Bringing {Mapudungun} into the Modern {MT} Ecosystem: Morphology-Aware Tokenization for {NLLB}-200 Fine-Tuning},
  author    = {Thompson, Isaac},
  booktitle = {Proceedings of the 5th Workshop on NLP for Indigenous Languages of the Americas (AmericasNLP 2026)},
  year      = {2026},
}