CoolFace
Modelpublic

JovialValley/model_syllable_onSet0

sourceHugging Faceapache-2.0updated 4y agoView on Hugging Face
0likes7downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

modelsyllableonSet0

This model is a fine-tuned version of facebook/wav2vec2-large-xlsr-53 on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.1789
  • 0 Precision: 1.0
  • 0 Recall: 0.9688
  • 0 F1-score: 0.9841
  • 0 Support: 32
  • 1 Precision: 0.9667
  • 1 Recall: 1.0
  • 1 F1-score: 0.9831
  • 1 Support: 29
  • 2 Precision: 1.0
  • 2 Recall: 1.0
  • 2 F1-score: 1.0
  • 2 Support: 29
  • 3 Precision: 1.0
  • 3 Recall: 1.0
  • 3 F1-score: 1.0
  • 3 Support: 8
  • Accuracy: 0.9898
  • Macro avg Precision: 0.9917
  • Macro avg Recall: 0.9922
  • Macro avg F1-score: 0.9918
  • Macro avg Support: 98
  • Weighted avg Precision: 0.9901
  • Weighted avg Recall: 0.9898
  • Weighted avg F1-score: 0.9898
  • Weighted avg Support: 98
  • Wer: 0.4059
  • Mtrix: [[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 0, 29, 0], [3, 0, 0, 0, 8]]

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0003
  • trainbatchsize: 8
  • evalbatchsize: 8
  • seed: 42
  • gradientaccumulationsteps: 2
  • totaltrainbatch_size: 16
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lrschedulertype: linear
  • lrschedulerwarmup_steps: 200
  • num_epochs: 70
  • mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation Loss0 Precision0 Recall0 F1-score0 Support1 Precision1 Recall1 F1-score1 Support2 Precision2 Recall2 F1-score2 Support3 Precision3 Recall3 F1-score3 SupportAccuracyMacro avg PrecisionMacro avg RecallMacro avg F1-scoreMacro avg SupportWeighted avg PrecisionWeighted avg RecallWeighted avg F1-scoreWeighted avg SupportWerMtrix
1.63594.161001.56220.00.00.0320.00.00.0290.23330.72410.3529290.00.00.080.21430.05830.18100.0882980.06900.21430.1044980.9761[[0, 1, 2, 3], [0, 0, 0, 32, 0], [1, 0, 0, 29, 0], [2, 8, 0, 21, 0], [3, 0, 0, 8, 0]]
1.49418.332001.25500.00.00.0320.00.00.0290.23330.72410.3529290.00.00.080.21430.05830.18100.0882980.06900.21430.1044980.9761[[0, 1, 2, 3], [0, 0, 0, 32, 0], [1, 0, 0, 29, 0], [2, 8, 0, 21, 0], [3, 0, 0, 8, 0]]
1.106212.493001.19190.00.00.0320.00.00.0290.23330.72410.3529290.00.00.080.21430.05830.18100.0882980.06900.21430.1044980.9761[[0, 1, 2, 3], [0, 0, 0, 32, 0], [1, 0, 0, 29, 0], [2, 8, 0, 21, 0], [3, 0, 0, 8, 0]]
1.028716.654000.93340.00.00.0320.00.00.0290.23330.72410.3529290.00.00.080.21430.05830.18100.0882980.06900.21430.1044980.9761[[0, 1, 2, 3], [0, 0, 0, 32, 0], [1, 0, 0, 29, 0], [2, 8, 0, 21, 0], [3, 0, 0, 8, 0]]
0.912420.825000.84850.00.00.0320.00.00.0290.23330.72410.3529290.00.00.080.21430.05830.18100.0882980.06900.21430.1044980.9761[[0, 1, 2, 3], [0, 0, 0, 32, 0], [1, 0, 0, 29, 0], [2, 8, 0, 21, 0], [3, 0, 0, 8, 0]]
0.882224.986000.90730.00.00.0320.00.00.0290.23330.72410.3529290.00.00.080.21430.05830.18100.0882980.06900.21430.1044980.9761[[0, 1, 2, 3], [0, 0, 0, 32, 0], [1, 0, 0, 29, 0], [2, 8, 0, 21, 0], [3, 0, 0, 8, 0]]
0.811729.167000.80521.00.93750.9677320.90621.00.9508291.00.96550.9825291.01.01.080.96940.97660.97580.9753980.97230.96940.9697981.0[[0, 1, 2, 3], [0, 30, 2, 0, 0], [1, 0, 29, 0, 0], [2, 0, 1, 28, 0], [3, 0, 0, 0, 8]]
0.794433.338000.75541.00.96880.9841320.93551.00.9667291.00.96550.9825291.01.01.080.97960.98390.98360.9833980.98090.97960.9798981.0[[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 1, 28, 0], [3, 0, 0, 0, 8]]
0.747337.499000.72031.00.96880.9841320.96671.00.9831291.01.01.0291.01.01.080.98980.99170.99220.9918980.99010.98980.9898981.0[[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 0, 29, 0], [3, 0, 0, 0, 8]]
0.369441.6510000.30121.00.96880.9841320.96671.00.9831291.01.01.0291.01.01.080.98980.99170.99220.9918980.99010.98980.9898980.6408[[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 0, 29, 0], [3, 0, 0, 0, 8]]
0.232245.8211000.20351.00.96880.9841320.96671.00.9831291.01.01.0291.01.01.080.98980.99170.99220.9918980.99010.98980.9898980.7970[[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 0, 29, 0], [3, 0, 0, 0, 8]]
0.199349.9812000.18341.00.96880.9841320.96671.00.9831291.01.01.0291.01.01.080.98980.99170.99220.9918980.99010.98980.9898980.6420[[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 0, 29, 0], [3, 0, 0, 0, 8]]
0.219554.1613000.17911.00.96880.9841320.96671.00.9831291.01.01.0291.01.01.080.98980.99170.99220.9918980.99010.98980.9898980.7617[[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 0, 29, 0], [3, 0, 0, 0, 8]]
0.169158.3314000.16601.00.96880.9841320.96671.00.9831291.01.01.0291.01.01.080.98980.99170.99220.9918980.99010.98980.9898980.7058[[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 0, 29, 0], [3, 0, 0, 0, 8]]
0.15462.4915000.17971.00.96880.9841320.96671.00.9831291.01.01.0291.01.01.080.98980.99170.99220.9918980.99010.98980.9898980.4367[[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 0, 29, 0], [3, 0, 0, 0, 8]]
0.1566.6516000.17901.00.96880.9841320.96671.00.9831291.01.01.0291.01.01.080.98980.99170.99220.9918980.99010.98980.9898980.3888[[0, 1, 2, 3], [0, 31, 1, 0, 0], [1, 0, 29, 0, 0], [2, 0, 0, 29, 0], [3, 0, 0, 0, 8]]

Framework versions

  • Transformers 4.25.1
  • Pytorch 1.13.0+cu116
  • Datasets 2.8.0
  • Tokenizers 0.13.2