CoolFace
Modelpublic

davelotito/donut-base-sroie-metrics-combined

sourceHugging Facemitupdated 2y agoView on Hugging Face
0likes8downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

donut-base-sroie-metrics-combined

This model is a fine-tuned version of naver-clova-ix/donut-base on the imagefolder dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.2827
  • —Bleu score: 0.0762
  • —Precisions: [0.8396396396396396, 0.7886178861788617, 0.7435897435897436, 0.7049180327868853]
  • —Brevity penalty: 0.0993
  • —Length ratio: 0.3021
  • —Translation length: 555
  • —Reference length: 1837
  • —Cer: 0.7452
  • —Wer: 0.8162
  • —Cer Hugging Face: 0.7544
  • —Wer Hugging Face: 0.8233

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 2e-05
  • —trainbatchsize: 4
  • —evalbatchsize: 4
  • —seed: 42
  • —gradientaccumulationsteps: 2
  • —totaltrainbatch_size: 8
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —num_epochs: 4
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossBleu scorePrecisionsBrevity penaltyLength ratioTranslation lengthReference lengthCerWerCer Hugging FaceWer Hugging Face
No log0.99620.34780.0756[0.8178571428571428, 0.7625754527162978, 0.7142857142857143, 0.6711590296495957]0.10220.304856018370.74740.82430.75700.8333
0.26342.01250.28730.0763[0.8345323741007195, 0.7829614604462475, 0.7418604651162791, 0.7029972752043597]0.09990.302755618370.74350.82190.75270.8288
0.26342.991870.28170.0777[0.8369175627240143, 0.7838383838383839, 0.7476851851851852, 0.7127371273712737]0.10110.303855818370.74070.81520.74980.8215
0.2633.972480.28270.0762[0.8396396396396396, 0.7886178861788617, 0.7435897435897436, 0.7049180327868853]0.09930.302155518370.74520.81620.75440.8233

Framework versions

  • —Transformers 4.40.0.dev0
  • —Pytorch 2.1.0
  • —Datasets 2.18.0
  • —Tokenizers 0.15.2