CoolFace
Modelpublic

DL-Project/hatespeech_wav2vec2

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes13downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

hatespeech_wav2vec2

This model is a fine-tuned version of facebook/wav2vec2-base on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.6562
  • Accuracy: 0.6216
  • Recall: 0.7853
  • Precision: 0.5990
  • F1: 0.6796

It achieves the following results on the test set:

  • Loss: 0.6597
  • Accuracy: 0.6192
  • Recall: 0.7822
  • Precision: 0.5944
  • F1: 0.6755

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 4e-05
  • trainbatchsize: 32
  • evalbatchsize: 32
  • seed: 42
  • gradientaccumulationsteps: 4
  • totaltrainbatch_size: 128
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lrschedulertype: linear
  • lrschedulerwarmup_ratio: 0.1
  • num_epochs: 10

Training results

Training LossEpochStepValidation LossAccuracyRecallPrecisionF1
No log0.9935770.68710.54300.90210.53110.6686
0.68992.01550.67790.56470.90210.54480.6793
0.67612.99352320.66490.59340.55410.61310.5821
0.66074.03100.65500.62890.65040.63340.6417
0.66074.99353870.65620.62160.78530.59900.6796
0.64036.04650.65780.63570.69690.62980.6617
0.61296.99355420.66230.63130.72770.61840.6686
0.60248.06200.67450.63450.74900.61740.6769
0.57798.99356970.68070.64060.65670.64600.6513
0.57799.93557700.67980.63370.69930.62700.6612

Framework versions

  • Transformers 4.40.2
  • Pytorch 2.2.1+cu121
  • Datasets 2.19.1
  • Tokenizers 0.19.1