CoolFace
Modelpublic

livinNector/m-minilm-l12-h384-dra-tam-mal-ai-gen-review-classification-finetune-2c

sourceHugging Facemitupdated 2y agoView on Hugging Face
0likes5downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

m-minilm-l12-h384-dra-tam-mal-ai-gen-review-classification-finetune-2c

This model is a fine-tuned version of microsoft/Multilingual-MiniLM-L12-H384 on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.2707
  • —Accuracy: 0.9783
  • —F1: 0.9783

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0001
  • —trainbatchsize: 128
  • —evalbatchsize: 128
  • —seed: 22
  • —optimizer: Use OptimizerNames.ADAMWTORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: linear
  • —num_epochs: 6

Training results

Training LossEpochStepValidation LossAccuracyF1
0.69080.363640.67890.50.3333
0.65430.727380.56840.92860.9285
0.5121.0909120.40130.95030.9502
0.38341.4545160.27070.97830.9783
0.31391.8182200.31290.91610.9156
0.21872.1818240.19470.97200.9720
0.21192.5455280.17610.97200.9720
0.17772.9091320.16540.96890.9689
0.23223.2727360.15330.97200.9720
0.21683.6364400.16970.96270.9627
0.15264.0440.13190.97520.9752
0.15554.3636480.14080.97200.9720
0.14354.7273520.13200.97520.9751
0.11145.0909560.12960.97520.9751
0.13625.4545600.13430.97200.9720
0.10985.8182640.12990.97200.9720

Framework versions

  • —Transformers 4.47.1
  • —Pytorch 2.5.1+cu124
  • —Tokenizers 0.21.0