CoolFace
Modelpublic

Chrispfield/bert-base-uncased-issues-128

sourceHugging Faceapache-2.0updated 4y agoView on Hugging Face
0likes17downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

bert-base-uncased-issues-128

This model is a fine-tuned version of bert-base-uncased on the emotion dataset. It achieves the following results on the evaluation set:

  • Loss: 2.3196

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • trainbatchsize: 32
  • evalbatchsize: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lrschedulertype: linear
  • num_epochs: 16

Training results

Training LossEpochStepValidation Loss
2.65861.05002.4203
2.46552.010002.3889
2.37693.015002.3279
2.30244.020002.3623
2.21785.025002.4500
2.13526.030002.3042
2.07937.035002.3053
2.04628.040002.2402
1.98869.045002.3407
1.939310.050002.2826
1.90411.055002.3401
1.874212.060002.3276
1.844113.065002.2815
1.808214.070002.2739
1.805815.075002.3225
1.795116.080002.2933

Framework versions

  • Transformers 4.21.1
  • Pytorch 1.12.0+cu113
  • Datasets 2.4.0
  • Tokenizers 0.12.1