CoolFace
Modelpublic

thangtrungnguyen/vietnamese-regional-accent-classification-model

sourceHugging Facecc-by-nc-4.0updated 2y agoView on Hugging Face
0likes83downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

vietnamese-regional-accent-classification-model

This model achieves the following results on the evaluation set:

  • —Loss: 0.5951
  • —F1: 0.8217

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 5e-05
  • —trainbatchsize: 64
  • —evalbatchsize: 64
  • —seed: 42
  • —gradientaccumulationsteps: 4
  • —totaltrainbatch_size: 256
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —lrschedulerwarmup_ratio: 0.1
  • —num_epochs: 11

Training results

Training LossEpochStepF1Validation Loss
1.05071.0440.75630.8615
0.81572.0880.78040.7120
0.75553.01320.79810.6501
0.70064.01760.76350.6767
0.68255.02200.80050.6370
0.65956.02640.77350.6832
0.66347.03080.80780.6044
0.6278.03520.78730.6399
0.6039.03960.82550.5825
0.597710.04400.81800.5931
0.563511.04840.82170.5951

Framework versions

  • —Transformers 4.45.1
  • —Pytorch 2.4.0
  • —Datasets 3.0.1
  • —Tokenizers 0.20.0