Modelpublic

sinhala-nlp/gemma-3-12b-it-TamSiPara-Ta2Si-si

sourceHugging Facegemmaupdated 2mo agoView on Hugging Face

0likes8downloads

Model Card

gemma-3-12b-it-TamSiPara-Ta2Si-si

A LoRA adapter for Tamil to Sinhala machine translation, trained on the TamSiPara Tamil-Sinhala parallel corpus (Pushpananda et al., 2024) as part of the SinGen Sinhala text generation benchmark.

The adapter is trained on top of google/gemma-3-12b-it using the model's own chat template, with the same instruction wording as the SinGen zero-shot and few-shot prompting runs.

Usage

python

from transformers import AutoProcessor, AutoModelForImageTextToText
from peft import PeftModel

processor = AutoProcessor.from_pretrained("google/gemma-3-12b-it")
model = AutoModelForImageTextToText.from_pretrained("google/gemma-3-12b-it", dtype="auto", device_map="auto")
model = PeftModel.from_pretrained(model, "sinhala-nlp/gemma-3-12b-it-TamSiPara-Ta2Si-si")

(Use AutoTokenizer / AutoModelForCausalLM for text-only checkpoints.)

The model continues from the Translation: prefix inside the assistant turn.

Training


Training pairs	21624
Instruction language	`si`
Epochs	3.0
Effective batch size	16
Learning rate	0.0002
Max sequence length	768
LoRA r / alpha / dropout	16 / 32 / 0.05
Target modules	language-model linear layers (vision tower excluded)

Evaluation

Held-out tail of TamSiPara (999 sentence pairs), whitespace-tokenized (sacreBLEU's default 13a tokenizer splits Sinhala conjuncts and vowel signs):

Metric	Score
Corpus sacreBLEU	14.87
Sentence-level BLEU mean	7.56

Licence

Derived from Gemma and governed by the Gemma Terms of Use.