CoolFace
Modelpublic

MayBashendy/ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k18_task1_organization

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes5downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

ArabicNewSplits7OSSusingWellWrittenEssaysFineTuningAraBERTrun1AugV5k18task1organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.9071
  • Qwk: 0.6711
  • Mse: 0.9071
  • Rmse: 0.9524

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • trainbatchsize: 8
  • evalbatchsize: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lrschedulertype: linear
  • num_epochs: 100

Training results

Training LossEpochStepValidation LossQwkMseRmse
No log0.014827.20940.07.20942.6850
No log0.029644.49990.03174.49992.1213
No log0.044463.09110.07023.09111.7581
No log0.059382.08610.21542.08611.4443
No log0.0741101.64850.19051.64851.2839
No log0.0889121.53000.11651.53001.2369
No log0.1037141.56150.30361.56151.2496
No log0.1185161.87950.09431.87951.3709
No log0.1333182.04830.03672.04831.4312
No log0.1481201.98040.08851.98041.4073
No log0.1630221.63600.19051.63601.2791
No log0.1778241.47860.25931.47861.2160
No log0.1926261.35120.32731.35121.1624
No log0.2074281.23470.30911.23471.1112
No log0.2222301.24830.38941.24831.1173
No log0.2370321.28390.46281.28391.1331
No log0.2519341.45410.37101.45411.2058
No log0.2667361.23850.51611.23851.1129
No log0.2815381.12880.49211.12881.0624
No log0.2963401.26420.51.26421.1244
No log0.3111421.15110.46771.15111.0729
No log0.3259441.63970.28791.63971.2805
No log0.3407462.25970.27032.25971.5032
No log0.3556481.95990.32861.95991.4000
No log0.3704501.29780.50771.29781.1392
No log0.3852521.15410.50821.15411.0743
No log0.4541.21720.51.21721.1033
No log0.4148561.11110.56921.11111.0541
No log0.4296580.99400.60.99400.9970
No log0.4444601.09970.62601.09971.0487
No log0.4593620.96880.65190.96880.9843
No log0.4741640.77710.70750.77710.8815
No log0.4889660.86050.67130.86050.9276
No log0.5037681.00010.63381.00011.0000
No log0.5185700.93240.58650.93240.9656
No log0.5333720.75800.71140.75800.8706
No log0.5481740.80200.74210.80200.8956
No log0.5630760.91900.71740.91900.9586
No log0.5778780.82970.75280.82970.9109
No log0.5926800.68350.74850.68350.8267
No log0.6074820.96380.71190.96380.9817
No log0.6222841.43930.56821.43931.1997
No log0.6370861.36950.55421.36951.1702
No log0.6519881.02420.67881.02421.0120
No log0.6667900.80980.68030.80980.8999
No log0.6815920.80270.64790.80270.8959
No log0.6963940.76480.65250.76480.8745
No log0.7111960.71920.72060.71920.8480
No log0.7259980.79190.68920.79190.8899
No log0.74071000.88920.69740.88920.9430
No log0.75561021.01150.71601.01151.0057
No log0.77041040.96000.70890.96000.9798
No log0.78521060.76310.70130.76310.8736
No log0.81080.81490.68030.81490.9027
No log0.81481100.98610.66260.98610.9930
No log0.82961120.97150.67110.97150.9856
No log0.84441140.88750.68030.88750.9421
No log0.85931160.83030.68120.83030.9112
No log0.87411180.80890.65670.80890.8994
No log0.88891200.77250.66670.77250.8789
No log0.90371220.75330.69060.75330.8680
No log0.91851240.73120.74130.73120.8551
No log0.93331260.71350.77240.71350.8447
No log0.94811280.73180.73100.73180.8555
No log0.96301300.78110.71050.78110.8838
No log0.97781320.83690.69330.83690.9148
No log0.99261340.88590.67550.88590.9412
No log1.00741360.98100.64900.98100.9905
No log1.02221380.88860.66670.88860.9426
No log1.03701400.84120.64380.84120.9172
No log1.05191420.80180.65770.80180.8954
No log1.06671440.83050.68830.83050.9113
No log1.08151461.00350.67951.00351.0017
No log1.09631481.05030.61841.05031.0249
No log1.11111500.89700.69180.89700.9471
No log1.12591520.62590.75900.62590.7912
No log1.14071540.57950.78820.57950.7613
No log1.15561560.60640.83330.60640.7787
No log1.17041580.58560.78530.58560.7653
No log1.18521600.64710.71430.64710.8044
No log1.21620.75330.68000.75330.8679
No log1.21481640.67330.74530.67330.8206
No log1.22961660.67180.76830.67180.8196
No log1.24441680.69160.75900.69160.8316
No log1.25931700.72890.74850.72890.8538
No log1.27411720.66470.77300.66470.8153
No log1.28891740.71210.72390.71210.8438
No log1.30371760.70320.70810.70320.8386
No log1.31851780.64240.72110.64240.8015
No log1.33331800.64600.70750.64600.8037
No log1.34811820.58840.78210.58840.7671
No log1.36301840.53300.81290.53300.7300
No log1.37781860.51680.82840.51680.7189
No log1.39261880.52450.82840.52450.7242
No log1.40741900.59450.81110.59450.7710
No log1.42221920.75190.77250.75190.8671
No log1.43701940.79350.73810.79350.8908
No log1.45191960.72010.71340.72010.8486
No log1.46671980.74760.68490.74760.8646
No log1.48152000.80620.63830.80620.8979
No log1.49632020.89110.62940.89110.9440
No log1.51112041.00700.61641.00701.0035
No log1.52592060.96850.63090.96850.9841
No log1.54072080.80340.67110.80340.8963
No log1.55562100.73930.70920.73930.8598
No log1.57042120.69030.75860.69030.8308
No log1.58522140.59540.77850.59540.7716
No log1.62160.53400.81290.53400.7307
No log1.61482180.54080.81290.54080.7354
No log1.62962200.58370.77630.58370.7640
No log1.64442220.56590.77630.56590.7523
No log1.65932240.57740.77630.57740.7599
No log1.67412260.57620.79470.57620.7591
No log1.68892280.58730.80260.58730.7663
No log1.70372300.60410.80790.60410.7772
No log1.71852320.60380.79740.60380.7770
No log1.73332340.68060.72480.68060.8250
No log1.74812360.86320.68390.86320.9291
No log1.76302380.91720.67920.91720.9577
No log1.77782400.75510.69230.75510.8690
No log1.79262420.64740.77030.64740.8046
No log1.80742440.68890.76390.68890.8300
No log1.82222460.71760.73240.71760.8471
No log1.83702480.70130.69280.70130.8374
No log1.85192500.61840.74390.61840.7864
No log1.86672520.57280.7750.57280.7568
No log1.88152540.56910.78980.56910.7544
No log1.89632560.60110.82350.60110.7753
No log1.91112580.66510.73970.66510.8155
No log1.92592600.72630.71010.72630.8523
No log1.94072620.82640.69060.82640.9091
No log1.95562640.85110.63830.85110.9226
No log1.97042660.78420.66200.78420.8856
No log1.98522680.70720.74320.70720.8410
No log2.02700.74280.74830.74280.8619
No log2.01482720.70690.73970.70690.8407
No log2.02962740.72000.72340.72000.8485
No log2.04442760.78690.67140.78690.8870
No log2.05932780.86970.64290.86970.9326
No log2.07412800.83880.66210.83880.9159
No log2.08892820.76000.70.76000.8718
No log2.10372840.74720.70.74720.8644
No log2.11852860.67060.750.67060.8189
No log2.13332880.58170.77850.58170.7627
No log2.14812900.59320.78430.59320.7702
No log2.16302920.76320.74070.76320.8736
No log2.17782940.76120.75780.76120.8724
No log2.19262960.62010.73970.62010.7875
No log2.20742980.56730.78380.56730.7532
No log2.22223000.59560.79170.59560.7717
No log2.23703020.62100.76060.62100.7881
No log2.25193040.71170.71830.71170.8436
No log2.26673060.92800.67070.92800.9633
No log2.28153080.92690.67440.92690.9627
No log2.29633100.71840.71340.71840.8476
No log2.31113120.61120.79010.61120.7818
No log2.32593140.63830.77460.63830.7989
No log2.34073160.77000.71430.77000.8775
No log2.35563180.75420.69930.75420.8684
No log2.37043200.77970.69010.77970.8830
No log2.38523220.77940.68060.77940.8828
No log2.43240.75770.69930.75770.8704
No log2.41483260.65040.72730.65040.8065
No log2.42963280.62020.73760.62020.7875
No log2.44443300.65670.74630.65670.8104
No log2.45933320.69860.73130.69860.8358
No log2.47413340.73710.66670.73710.8586
No log2.48893360.73890.67160.73890.8596
No log2.50373380.65060.70150.65060.8066
No log2.51853400.57970.73530.57970.7614
No log2.53333420.56370.75560.56370.7508
No log2.54813440.58530.75680.58530.7650
No log2.56303460.67330.72730.67330.8206
No log2.57783480.66310.73830.66310.8143
No log2.59263500.60700.75360.60700.7791
No log2.60743520.63470.74650.63470.7967
No log2.62223540.67400.76920.67400.8209
No log2.63703560.61700.75710.61700.7855
No log2.65193580.63250.72860.63250.7953
No log2.66673600.63750.74480.63750.7985
No log2.68153620.61920.76190.61920.7869
No log2.69633640.67200.73240.67200.8198
No log2.71113660.74720.69930.74720.8644
No log2.72593680.79300.67630.79300.8905
No log2.74073700.82360.69010.82360.9075
No log2.75563720.83770.67630.83770.9152
No log2.77043740.76120.71830.76120.8725
No log2.78523760.71880.74650.71880.8478
No log2.83780.70190.750.70190.8378
No log2.81483800.70140.74650.70140.8375
No log2.82963820.74930.73330.74930.8656
No log2.84443840.73930.76360.73930.8598
No log2.85933860.65990.80490.65990.8124
No log2.87413880.64210.81660.64210.8013
No log2.88893900.61390.79750.61390.7835
No log2.90373920.64570.78750.64570.8036
No log2.91853940.76140.70670.76140.8726
No log2.93333960.81270.67130.81270.9015
No log2.94813980.77200.70500.77200.8787
No log2.96304000.69870.73760.69870.8359
No log2.97784020.66780.76060.66780.8172
No log2.99264040.63270.74130.63270.7954
No log3.00744060.61200.77920.61200.7823
No log3.02224080.63440.77920.63440.7965
No log3.03704100.72260.76570.72260.8501
No log3.05194120.70570.76570.70570.8400
No log3.06674140.61360.80720.61360.7833
No log3.08154160.59170.77920.59170.7692
No log3.09634180.60870.80.60870.7802
No log3.11114200.63230.77850.63230.7951
No log3.12594220.63910.77240.63910.7995
No log3.14074240.66690.74290.66690.8166
No log3.15564260.66260.74290.66260.8140
No log3.17044280.59910.77850.59910.7740
No log3.18524300.52590.80260.52590.7252
No log3.24320.57920.77550.57920.7610
No log3.21484340.52860.81050.52860.7271
No log3.22964360.53940.82630.53940.7345
No log3.24444380.86130.72430.86130.9281
No log3.25934400.97530.71510.97530.9876
No log3.27414420.79190.69880.79190.8899
No log3.28894440.61060.78710.61060.7814
No log3.30374460.65320.78670.65320.8082
No log3.31854480.71190.72970.71190.8438
No log3.33334500.67360.76190.67360.8207
No log3.34814520.64630.76190.64630.8039
No log3.36304540.79380.68870.79380.8909
No log3.37784560.99570.62820.99570.9979
No log3.39264581.00580.62821.00581.0029
No log3.40744600.85710.67110.85710.9258
No log3.42224620.73330.72480.73330.8563
No log3.43704640.68520.74480.68520.8278
No log3.45194660.69500.73240.69500.8337
No log3.46674680.72930.72340.72930.8540
No log3.48154700.76660.72600.76660.8755
No log3.49634720.74990.72480.74990.8659
No log3.51114740.74240.70830.74240.8616
No log3.52594760.69970.72220.69970.8365
No log3.54074780.68500.73240.68500.8277
No log3.55564800.74190.70750.74190.8613
No log3.57044820.81930.70.81930.9051
No log3.58524840.84680.70.84680.9202
No log3.64860.72210.73200.72210.8497
No log3.61484880.61770.75360.61770.7860
No log3.62964900.60720.76260.60720.7792
No log3.64444920.59500.77140.59500.7714
No log3.65934940.63610.75860.63610.7975
No log3.67414960.81040.70060.81040.9002
No log3.68894980.89970.66670.89970.9485
0.43693.70375000.82550.68790.82550.9086
0.43693.71855020.66130.74320.66130.8132
0.43693.73335040.59090.79470.59090.7687
0.43693.74815060.59080.80260.59080.7686
0.43693.76305080.63070.7750.63070.7942
0.43693.77785100.70660.73080.70660.8406
0.43693.79265120.76900.70890.76900.8769
0.43693.80745140.72290.72610.72290.8502
0.43693.82225160.65070.74670.65070.8067
0.43693.83705180.61590.77550.61590.7848
0.43693.85195200.58270.80.58270.7634
0.43693.86675220.56570.80.56570.7521
0.43693.88155240.56210.79470.56210.7497
0.43693.89635260.56380.78710.56380.7508
0.43693.91115280.61740.76730.61740.7857
0.43693.92595300.78140.73030.78140.8840
0.43693.94075320.85970.71510.85970.9272
0.43693.95565340.78410.70510.78410.8855
0.43693.97045360.67750.75520.67750.8231
0.43693.98525380.64300.73530.64300.8019
0.43694.05400.64280.74820.64280.8017
0.43694.01485420.68590.70590.68590.8282
0.43694.02965440.77650.67630.77650.8812
0.43694.04445460.80830.61430.80830.8990
0.43694.05935480.80230.65690.80230.8957
0.43694.07415500.72930.72860.72930.8540
0.43694.08895520.71120.76390.71120.8433
0.43694.10375540.72190.76060.72190.8496
0.43694.11855560.72180.72460.72180.8496
0.43694.13335580.78980.69570.78980.8887
0.43694.14815600.84840.62860.84840.9211
0.43694.16305620.81230.67140.81230.9013
0.43694.17785640.71340.70830.71340.8446
0.43694.19265660.60910.77330.60910.7804
0.43694.20745680.56370.80770.56370.7508
0.43694.22225700.56540.78980.56540.7519
0.43694.23705720.58390.78980.58390.7642
0.43694.25195740.64960.77630.64960.8060
0.43694.26675760.71270.69740.71270.8442
0.43694.28155780.71360.67120.71360.8448
0.43694.29635800.70830.67670.70830.8416
0.43694.31115820.67040.71530.67040.8188
0.43694.32595840.66760.74450.66760.8171
0.43694.34075860.68410.74290.68410.8271
0.43694.35565880.69290.72590.69290.8324
0.43694.37045900.69340.72590.69340.8327
0.43694.38525920.69150.73530.69150.8315
0.43694.45940.71190.70500.71190.8438
0.43694.41485960.75240.73830.75240.8674
0.43694.42965980.73570.74670.73570.8577
0.43694.44446000.70840.74840.70840.8417
0.43694.45936020.68350.76620.68350.8267
0.43694.47416040.72420.70750.72420.8510
0.43694.48896060.82360.66670.82360.9075
0.43694.50376080.80740.68570.80740.8986
0.43694.51856100.73790.70150.73790.8590
0.43694.53336120.69360.70680.69360.8328
0.43694.54816140.64920.71640.64920.8057
0.43694.56306160.63260.72460.63260.7954
0.43694.57786180.64140.75860.64140.8009
0.43694.59266200.67650.76510.67650.8225
0.43694.60746220.72630.69390.72630.8523
0.43694.62226240.75630.66670.75630.8696
0.43694.63706260.79040.66670.79040.8890
0.43694.65196280.81530.64340.81530.9030
0.43694.66676300.76950.65690.76950.8772
0.43694.68156320.76030.70150.76030.8720
0.43694.69636340.75670.67670.75670.8699
0.43694.71116360.73570.70150.73570.8578
0.43694.72596380.71210.70590.71210.8439
0.43694.74076400.74880.72480.74880.8654
0.43694.75566420.77750.72850.77750.8818
0.43694.77046440.73260.73680.73260.8559
0.43694.78526460.64570.76510.64570.8036
0.43694.86480.62310.77030.62310.7894
0.43694.81486500.62860.77030.62860.7929
0.43694.82966520.66870.74480.66870.8177
0.43694.84446540.77230.68920.77230.8788
0.43694.85936560.91670.70060.91670.9575
0.43694.87416580.89820.67570.89820.9478
0.43694.88896600.80130.65670.80130.8952
0.43694.90376620.76840.68180.76840.8766
0.43694.91856640.73340.69700.73340.8564
0.43694.93336660.70500.74070.70500.8396
0.43694.94816680.67370.76510.67370.8208
0.43694.96306700.68070.75820.68070.8250
0.43694.97786720.70130.76130.70130.8374
0.43694.99266740.70320.73830.70320.8385
0.43695.00746760.70910.73970.70910.8421
0.43695.02226780.71760.72340.71760.8471
0.43695.03706800.68090.74290.68090.8251
0.43695.05196820.68430.73910.68430.8272
0.43695.06676840.71760.71530.71760.8471
0.43695.08156860.77140.65190.77140.8783
0.43695.09636880.89050.67130.89050.9436
0.43695.11116901.02200.64241.02201.0109
0.43695.12596921.03620.65481.03621.0180
0.43695.14076940.90710.67110.90710.9524

Framework versions

  • Transformers 4.44.2
  • Pytorch 2.4.0+cu118
  • Datasets 2.21.0
  • Tokenizers 0.19.1