CoolFace
Modelpublic

gabrielblins/bert-mini-emotion_classifier

sourceHugging Facemitupdated 3y agoView on Hugging Face
0likes8downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

bert-mini-emotion_classifier

This model is a fine-tuned version of prajjwal1/bert-mini on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.0648
  • F1: 0.9315
  • Roc Auc: 0.9589
  • Accuracy: 0.9224

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • trainbatchsize: 64
  • evalbatchsize: 64
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lrschedulertype: linear
  • lrschedulerwarmup_steps: 5
  • num_epochs: 1

Training results

Training LossEpochStepValidation LossF1Roc AucAccuracy
0.41760.15000.29290.67550.76870.5550
0.22780.1910000.16230.89310.92460.8630
0.15130.2915000.11840.91850.94500.9022
0.11980.3820000.09570.92740.95360.9197
0.10110.4825000.08150.93060.95680.9230
0.08810.5830000.07290.93200.95750.9237
0.08150.6735000.06690.93370.95960.9256
0.07670.7740000.06330.93460.96090.9260
0.07210.8645000.06120.93330.96020.9233
0.0710.9650000.06010.93390.96070.9251

Framework versions

  • Transformers 4.36.2
  • Pytorch 2.1.2+cu121
  • Datasets 2.16.0
  • Tokenizers 0.15.0