CoolFace
Modelpublic

sidovic/flan-t5-base-mimic-med-reports

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes9downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

flan-t5-base-mimic-med-reports

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.2032
  • Rouge1: 52.8742
  • Rouge2: 42.4294
  • Rougel: 51.1178
  • Rougelsum: 51.8773
  • Meteor: 47.6053
  • Bleu4: 14.2811
  • Bleu-p1: 61.1865
  • Bleu-p2: 43.5135
  • Bleu-p3: 33.9223
  • Bleu-p4: 25.8304
  • Gen Len: 13.4702

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • trainbatchsize: 8
  • evalbatchsize: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lrschedulertype: linear
  • num_epochs: 4

Training results

Training LossEpochStepValidation LossRouge1Rouge2RougelRougelsumMeteorBleu4Bleu-p1Bleu-p2Bleu-p3Bleu-p4Gen Len
0.26271.0104970.223551.068739.67449.615450.136145.643813.152660.412540.813431.152123.629913.2415
0.23762.0209940.210251.560340.833949.824750.521246.224413.194160.873342.162232.869724.937413.1225
0.233.0314910.205152.573141.738150.850251.676747.227014.033760.968142.823133.124825.125613.4702
0.22884.0419880.203252.874242.429451.117851.877347.605314.281161.186543.513533.922325.830413.4702

Framework versions

  • Transformers 4.39.3
  • Pytorch 2.1.2
  • Datasets 2.18.0
  • Tokenizers 0.15.2