Modelpublic

meghazisofiane/opus-mt-en-ar-evaluated-en-to-ar-2000instances-un_multi-leaningRate2e-05-batchSize8-11-action-1

sourceHugging Faceapache-2.0updated 4y agoView on Hugging Face

0likes9downloads

Model Card

opus-mt-en-ar-evaluated-en-to-ar-2000instances-un_multi-leaningRate2e-05-batchSize8-11-action-1

This model is a fine-tuned version of Helsinki-NLP/opus-mt-en-ar on the un_multi dataset. It achieves the following results on the evaluation set:

—Loss: 0.1873
—Bleu: 53.0137
—Meteor: 0.5005
—Gen Len: 25.845

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 2e-05
—trainbatchsize: 8
—evalbatchsize: 8
—seed: 42
—optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
—lrschedulertype: linear
—num_epochs: 11

Training results

Training Loss	Epoch	Step	Validation Loss	Bleu	Meteor	Gen Len
0.6585	0.5	100	0.2085	52.5874	0.4969	25.485
0.1802	1.0	200	0.1788	52.9434	0.4982	25.1725
0.1501	1.5	300	0.1683	53.6994	0.5033	25.625
0.1454	2.0	400	0.1706	53.3946	0.5005	25.6675
0.1193	2.5	500	0.1774	53.2011	0.4982	25.58
0.1194	3.0	600	0.1741	53.8651	0.5026	25.5775
0.1002	3.5	700	0.1878	53.1332	0.5005	25.8975
0.0979	4.0	800	0.1881	52.5989	0.4974	25.485
0.0807	4.5	900	0.1873	53.0137	0.5005	25.845

Framework versions

—Transformers 4.18.0
—Pytorch 1.11.0
—Datasets 2.1.0
—Tokenizers 0.12.1