CoolFace
Modelpublic

HerbertAIHug/Roberta-classweight-Sentiment-identifier

sourceHugging Facemitupdated 3y agoView on Hugging Face
0likes21downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

Roberta-classweight-Sentiment-identifier

This model is a fine-tuned version of roberta-base on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.8158
  • —F1: 0.6592

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 5e-05
  • —trainbatchsize: 8
  • —evalbatchsize: 8
  • —seed: 42
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —num_epochs: 5

Training results

Training LossEpochStepValidation LossF1
0.82120.55001.15750.2482
0.81561.010000.81640.6421
0.82911.515000.81580.6592
0.80442.0120000.83150.6372
0.79372.5125000.83620.6618
0.80943.0130000.81880.6703
0.8333.5135000.84470.6650
0.82594.0140000.84780.6631
0.83744.5145000.82550.6626

Framework versions

  • —Transformers 4.33.1
  • —Pytorch 2.0.1+cu118
  • —Datasets 2.14.5
  • —Tokenizers 0.13.3