Modelpublic

Klarly/multilingual-MT_Medical-Diagnostics_ROM

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes7downloads

Model Card

Model Card for Model ID

This model is a fine-tuned version of Helsinki-NLP/opus-mt-en-roa on a dataset of medical diagnostic technical content.

Model Description

—Developed by: Chiara Baffelli
—Language(s) (NLP): EN, FR, ES, IT, PT, RO
—Finetuned from model [optional]: Helsinki-NLP/opus-mt-en-roa

Training Hyperparameters

The following hyperparameters were used during training:

—learning_rate: 0.001
—trainbatchsize: 32
—evalbatchsize: 32
—seed: 42
—gradientaccumulationsteps: 4
—totaltrainbatch_size: 128
—optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
—lrschedulertype: linear
—num_epochs: 4
—mixedprecisiontraining: Native AMP

Framework versions

—Transformers 4.41.1
—Pytorch 2.3.0+cu121
—Datasets 2.19.1
—Tokenizers 0.19.1