CoolFace
Modelpublic

everyl12/crisis_sentiment_roberta

sourceHugging Faceupdated 4y agoView on Hugging Face
0likes23downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

crisissentimentroberta

This model is a fine-tuned version of finiteautomata/bertweet-base-sentiment-analysis on an unknown dataset. It achieves the following results on the testing set:

  • —Accuracy: 0.83
  • —Macro accuracy: 0.76
  • —Weighted accuracy: 0.83

Model description

  1. 1.Negative
  2. 2.Positive
  3. 3.Neutral

Sentiment classification using 9,300 tweets of the Flint Water Crisis

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 2e-05
  • —trainbatchsize: 16
  • —evalbatchsize: 16
  • —seed: 42
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —num_epochs: 15

Training results

Training LossEpochStepValidation LossAccuracy
0.47811.03490.44520.8366
0.20742.06980.50100.8237
0.0473.010470.57720.8199
0.01144.013960.77930.8226
0.0075.017450.85840.8188
0.01446.020940.95170.8070
0.00177.024431.00540.8231
0.00138.027921.12970.8172
0.00089.031411.16220.8263
0.00110.034901.23130.8204
0.000611.038391.23600.8220
0.000712.041881.26870.8161
0.000413.045371.29400.8204
0.045114.048861.31630.8194
0.000415.052351.29910.8242

Framework versions

  • —Transformers 4.23.0.dev0
  • —Pytorch 1.13.0.dev20220917+cu117
  • —Datasets 2.4.0
  • —Tokenizers 0.12.1