CoolFace
Modelpublic

lucaordronneau/twitter-roberta-base-sentiment-latest-finetuned-FG-SINGLE_SENTENCE-NEWS

sourceHugging Faceupdated 4y agoView on Hugging Face
0likes219downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

twitter-roberta-base-sentiment-latest-finetuned-FG-SINGLE_SENTENCE-NEWS

This model is a fine-tuned version of cardiffnlp/twitter-roberta-base-sentiment-latest on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 3.2822
  • —Accuracy: 0.6305
  • —F1: 0.6250

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 6e-05
  • —trainbatchsize: 32
  • —evalbatchsize: 32
  • —seed: 42
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —num_epochs: 20

Training results

Training LossEpochStepValidation LossAccuracyF1
No log1.03210.96460.56240.4048
0.95372.06420.94740.56440.4176
0.95373.09630.90080.59030.5240
0.8584.012840.99390.59990.5846
0.59085.016051.09470.61080.6026
0.59086.019261.25070.57400.5823
0.36767.022471.47170.61280.6017
0.22468.025681.67260.59650.6003
0.22469.028891.80410.63800.6298
0.146810.032101.97960.60530.6026
0.116111.035312.09880.62370.6202
0.116112.038522.41710.59440.5989
0.091613.041732.33260.63740.6288
0.091614.044942.54720.63600.6245
0.066115.048152.91270.61760.6187
0.045416.051362.91330.63260.6276
0.045417.054573.12990.62100.6162
0.033718.057783.18280.62240.6188
0.022319.060993.26550.62990.6223
0.022320.064203.28220.63050.6250

Framework versions

  • —Transformers 4.16.2
  • —Pytorch 1.9.1
  • —Datasets 1.18.4
  • —Tokenizers 0.11.6