CoolFace
Modelpublic

dinhlnd1610/xlnet-finetuned-socialmediatweet

sourceHugging Facemitupdated 3y agoView on Hugging Face
0likes84downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

xlnet-finetuned-socialmediatweet

This model is a fine-tuned version of xlnet-base-cased on the tweetsentimentmultilingual dataset. It achieves the following results on the evaluation set:

  • —Loss: 2.6923
  • —Accuracy: 0.7130

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 2e-05
  • —trainbatchsize: 32
  • —evalbatchsize: 32
  • —seed: 42
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —num_epochs: 20

Training results

Training LossEpochStepValidation LossAccuracy
0.01611.0582.45380.6821
0.04162.01162.37510.6821
0.02943.01742.49290.7068
0.0314.02322.56550.7037
0.04225.02903.08810.6605
0.07516.03482.67870.6883
0.02647.04062.52830.7006
0.01238.04642.56340.7006
0.02779.05222.71270.6852
0.044810.05802.61130.6759
0.026111.06382.66400.6759
0.011112.06962.60890.6914
0.023913.07542.57850.6975
0.025514.08122.69230.7130
0.024215.08702.47040.7068
0.013116.09282.67240.6667
0.005917.09862.55540.7068
0.006618.010442.66960.6698
0.00119.011022.56530.6883
0.002620.011602.58460.6883

Framework versions

  • —Transformers 4.35.2
  • —Pytorch 2.1.0+cu118
  • —Datasets 2.15.0
  • —Tokenizers 0.15.0