CoolFace
Modelpublic

genki10/ASAP_FineTuningBERT_UnAugV7_k1_task1_organization_k1_k1_fold1

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes1downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

ASAPFineTuningBERTUnAugV7k1task1organizationk1k1fold1

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.9828
  • —Qwk: 0.0583
  • —Mse: 0.9815
  • —Rmse: 0.9907

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 2e-05
  • —trainbatchsize: 64
  • —evalbatchsize: 64
  • —seed: 42
  • —optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: linear
  • —num_epochs: 100

Training results

Training LossEpochStepValidation LossQwkMseRmse
No log1.0110.83560.010710.83263.2913
No log2.029.88890.09.88623.1442
No log3.039.57530.09.57273.0940
No log4.049.32020.09.31763.0525
No log5.058.95980.08.95722.9929
No log6.068.27470.08.27212.8761
No log7.077.10830.07.10592.6657
No log8.086.54140.06.53912.5572
No log9.096.17640.06.17422.4848
No log10.0105.49760.01565.49542.3442
No log11.0114.81830.04.81612.1946
No log12.0124.31420.04.31222.0766
No log13.0133.93370.03.93171.9829
No log14.0143.55560.03.55361.8851
No log15.0153.23750.03.23551.7987
No log16.0162.97000.02.96811.7228
No log17.0172.71300.02.71121.6466
No log18.0182.4255-0.00052.42381.5568
No log19.0192.16880.07372.16711.4721
No log20.0201.96520.04821.96351.4013
No log21.0211.79230.04181.79071.3382
No log22.0221.65000.02111.64841.2839
No log23.0231.53870.01061.53711.2398
No log24.0241.43220.01.43071.1961
No log25.0251.28860.02111.28721.1345
No log26.0261.19490.02111.19351.0925
No log27.0271.11280.04181.11141.0542
No log28.0281.03500.05211.03371.0167
No log29.0290.98280.05830.98150.9907

Framework versions

  • —Transformers 4.47.0
  • —Pytorch 2.5.1+cu121
  • —Datasets 3.2.0
  • —Tokenizers 0.21.0