cartesinus/iva_mt_wslot-m2m100_418M-en-pl-lora_adapter

(WIP!) ivamtwslot-m2m100418M-en-pl-loraadapter

Notice: Although training results are good for some reason inference results are rather poor. I'm leaving this model here as a PoC that PERF LORA adaptation for M2M100 is possible.

This model is a LORA adapted version of facebook/m2m100_418M on the ivamtwslot dataset. It achieves the following results on the test set (measured with sacrebleu):

• —Bleu: 9.33

Using

The model can be used as follows:

First, clone the repository and navigate to the project directory:

git clone https://github.com/cartesinus/multiverb_iva_mt
cd multiverb_iva_mt

Then:

import csv
from iva_mt.iva_mt import IVAMT
import pandas as pd

lang = "es"
translator = IVAMT(lang, peft_model_id="cartesinus/iva_mt_wslot-m2m100_418M-en-es-lora_adapter", device="cuda:0", batch_size=128)
trans = translator.translate("here your example")[0]

Training results

Framework versions

• —PEFT 0.5.0