CoolFace
Modelpublic

Theivaprakasham/layoutlmv2-finetuned-sroie

sourceHugging Facecc-by-nc-sa-4.0updated 5y agoView on Hugging Face
2likes48downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

layoutlmv2-finetuned-sroie

This model is a fine-tuned version of microsoft/layoutlmv2-base-uncased on the sroie dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.0291
  • —Address Precision: 0.9341
  • —Address Recall: 0.9395
  • —Address F1: 0.9368
  • —Address Number: 347
  • —Company Precision: 0.9570
  • —Company Recall: 0.9625
  • —Company F1: 0.9598
  • —Company Number: 347
  • —Date Precision: 0.9885
  • —Date Recall: 0.9885
  • —Date F1: 0.9885
  • —Date Number: 347
  • —Total Precision: 0.9253
  • —Total Recall: 0.9280
  • —Total F1: 0.9266
  • —Total Number: 347
  • —Overall Precision: 0.9512
  • —Overall Recall: 0.9546
  • —Overall F1: 0.9529
  • —Overall Accuracy: 0.9961

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 5e-05
  • —trainbatchsize: 8
  • —evalbatchsize: 8
  • —seed: 42
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —lrschedulerwarmup_ratio: 0.1
  • —training_steps: 3000
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossAddress PrecisionAddress RecallAddress F1Address NumberCompany PrecisionCompany RecallCompany F1Company NumberDate PrecisionDate RecallDate F1Date NumberTotal PrecisionTotal RecallTotal F1Total NumberOverall PrecisionOverall RecallOverall F1Overall Accuracy
No log0.051570.81620.36700.72330.48693470.06170.01440.02343470.00.00.03470.00.00.03470.33460.18440.23780.9342
No log1.053140.34900.85640.89340.87453470.86100.92800.89323470.72970.85590.78783470.00.00.03470.81280.66930.73410.9826
No log2.054710.18450.79700.90490.84753470.92110.94240.93163470.98850.98850.98853470.00.00.03470.89780.70890.79230.9835
0.70273.056280.11940.90400.92220.91303470.88800.91350.90063470.98850.98850.98853470.00.00.03470.92630.70610.80130.9853
0.70274.057850.07620.93970.94240.94103470.88890.92220.90523470.98850.98850.98853470.77400.90780.83553470.89260.94020.91580.9928
0.70275.059420.05640.92820.93080.92953470.92960.95100.94023470.98850.98850.98853470.78010.85880.81763470.90360.93230.91770.9946
0.09356.0510990.05480.92220.92220.92223470.69750.73780.71713470.98850.98850.98853470.86080.87320.86703470.86480.88040.87250.9921
0.09357.0512560.04100.920.92800.92403470.94860.95680.95273470.98850.98850.98853470.90910.92220.91563470.94140.94880.94510.9961
0.09358.0514130.03690.93680.93950.93813470.95690.95970.95833470.97720.98850.98283470.91430.92220.91823470.94630.95240.94940.9960
0.0389.0515700.03430.92820.93080.92953470.96240.95970.96103470.98850.98850.98853470.92060.90200.91123470.95000.94520.94760.9958
0.03810.0517270.03170.93950.93950.93953470.95980.96250.96123470.98850.98850.98853470.92800.92800.92803470.95390.95460.95430.9963
0.03811.0518840.03120.93680.93950.93813470.95140.95970.95553470.98850.98850.98853470.92260.92800.92533470.94980.95390.95180.9960
0.023612.0520410.03180.93680.93950.93813470.95700.96250.95983470.98850.98850.98853470.90430.89910.90173470.94670.94740.94710.9956
0.023613.0521980.02910.93370.93370.93373470.95980.96250.96123470.98850.98850.98853470.91640.91640.91643470.94960.95030.94990.9960
0.023614.0523550.03000.92860.93660.93263470.94590.95680.95133470.98850.98850.98853470.92750.92220.92493470.94760.95100.94930.9959
0.017815.0525120.03070.93660.93660.93663470.95130.95680.95403470.98850.98850.98853470.92750.92220.92493470.95100.95100.95100.9959
0.017816.0526690.03000.93120.93660.93393470.95430.96250.95843470.98850.98850.98853470.91710.92510.92113470.94770.95320.95040.9959
0.017817.0528260.02920.93680.93950.93813470.95700.96250.95983470.98850.98850.98853470.92530.92800.92663470.95190.95460.95320.9961
0.017818.0529830.02910.93410.93950.93683470.95700.96250.95983470.98850.98850.98853470.92530.92800.92663470.95120.95460.95290.9961
0.014919.0130000.02910.93410.93950.93683470.95700.96250.95983470.98850.98850.98853470.92530.92800.92663470.95120.95460.95290.9961

Framework versions

  • —Transformers 4.16.2
  • —Pytorch 1.8.0+cu101
  • —Datasets 1.18.4.dev0
  • —Tokenizers 0.11.6