CoolFace
Modelpublic

ferrazzipietro/crfTaskLlama-3.2-1B-Instruct-unsup-crf-full-weight-merged-60k-loss-only-end

sourceHugging Faceupdated 8mo agoView on Hugging Face
0likes7downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

crfTaskLlama-3.2-1B-Instruct-unsup-crf-full-weight-merged-60k

This model is a fine-tuned version of ferrazzipietro/Llama-3.2-1B-Instruct-unsup-crf-full-weight-merged on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.2956
  • —F1 Micro: 0.9435
  • —F1 Macro: 0.6360
  • —F1 Weighted: 0.9458

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0003
  • —trainbatchsize: 16
  • —evalbatchsize: 128
  • —seed: 42
  • —distributed_type: multi-GPU
  • —gradientaccumulationsteps: 4
  • —totaltrainbatch_size: 64
  • —optimizer: Use OptimizerNames.ADAMWTORCH with betas=(0.9,0.999) and epsilon=1e-07 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: cosine
  • —lrschedulerwarmup_ratio: 0.1
  • —num_epochs: 1

Training results

Training LossEpochStepValidation LossF1 MicroF1 MacroF1 Weighted
24.18750.002426.15620.00.00.0
24.18750.004746.1250.00.00.0
24.35940.007166.05210.00.00.0
24.35940.009585.86460.00.00.0
23.40.0118105.56250.00.00.0
23.40.0142125.08330.00.00.0
23.40.0165144.54170.00.00.0
20.03750.0189163.93230.00.00.0
20.03750.0213183.36460.00.00.0
14.70940.0236202.85940.00.00.0
14.70940.0260222.33330.00.00.0
14.70940.0284241.84900.11960.00860.1695
9.53910.0307261.46880.50170.03080.3946
9.53910.0331281.22140.52160.06400.4459
5.50310.0355301.11200.45850.06820.4255
5.50310.0378320.99740.47180.06620.4540
5.50310.0402340.91410.58140.05310.4320
4.21640.0426360.85680.58140.05440.4379
4.21640.0449380.79430.40530.05430.3076
3.28910.0473400.73310.52160.07780.4881
3.28910.0496420.69660.59470.08550.4740
3.28910.0520440.66280.50830.15230.4747
2.75550.0544460.61850.63790.16070.5787
2.75550.0567480.58330.69440.18250.7030
2.36520.0591500.54690.72760.14860.6995
2.36520.0615520.51430.68110.23700.6874
2.36520.0638540.48890.78070.21630.7706
2.11410.0662560.46610.74090.18310.7336
2.11410.0686580.44730.75750.20440.7383
1.80940.0709600.43160.76080.18900.7697
1.80940.0733620.41930.76740.17440.7381
1.80940.0757640.41670.70760.19180.7069
1.75820.0780660.39780.80070.21440.7880
1.75820.0804680.38540.80400.21230.8030
1.53630.0827700.3750.82720.22600.8199
1.53630.0851720.37110.86380.22490.8619
1.53630.0875740.36590.84050.20110.8398
1.46090.0898760.36460.83390.23290.8293
1.46090.0922780.36130.85050.22690.8441
1.43950.0946800.35420.85710.21880.8501
1.43950.0969820.34960.84050.22360.8376
1.43950.0993840.35350.76080.27870.7733
1.42420.1017860.34640.82720.16250.8237
1.42420.1040880.33720.85380.22280.8518
1.36840.1064900.34240.81730.36330.8212
1.36840.1087920.34440.83720.22450.8296
1.36840.1111940.33590.87040.23880.8761
1.37340.1135960.33590.85050.31630.8645
1.37340.1158980.33460.83720.24970.8315
1.34180.11821000.33530.87040.41760.8711
1.34180.12061020.33460.83390.40640.8410
1.34180.12291040.33330.80070.21950.7854
1.33950.12531060.33010.87040.25810.8648
1.33950.12771080.33140.82390.29480.8182
1.29570.13001100.32810.91360.35930.9061
1.29570.13241120.32750.89370.34950.8910
1.29570.13481140.32940.90370.40580.9058
1.29260.13711160.32750.88700.37100.8938
1.29260.13951180.32680.89370.40270.8968
1.30270.14181200.32290.89370.40150.8936
1.30270.14421220.32360.90370.40940.9019
1.30270.14661240.32490.90030.41150.8979
1.30590.14891260.32620.89370.33290.8916
1.30590.15131280.32360.90030.41240.9020
1.30350.15371300.32290.87710.34150.8834
1.30350.15601320.32420.87380.27500.8754
1.30350.15841340.32290.88040.20670.8802
1.28950.16081360.32290.90370.32530.8993
1.28950.16311380.32490.86710.35550.8692
1.26950.16551400.32290.88040.30380.8820
1.26950.16781420.31970.89040.24300.8889
1.26950.17021440.31770.89700.33330.8947
1.28520.17261460.32030.89370.54170.8952
1.28520.17491480.32030.89700.53200.9005
1.30550.17731500.31770.89700.52000.8962
1.30550.17971520.32100.87040.35170.8644
1.30550.18201540.31900.90030.46120.9009
1.28320.18441560.32160.87710.49330.8800
1.28320.18681580.32100.88040.55340.8812
1.29410.18911600.31840.89700.43630.8920
1.29410.19151620.31710.90700.35490.8991
1.29410.19391640.31320.91030.35560.9027
1.25630.19621660.31250.90370.44430.8977
1.25630.19861680.31450.88370.52350.8803
1.22070.20091700.31450.89700.33260.8912
1.22070.20331720.31510.91030.44190.9043
1.22070.20571740.31450.91030.44170.9039
1.29220.20801760.31380.92690.45440.9220
1.29220.21041780.31510.92030.52670.9162
1.27930.21281800.31640.92030.52670.9163
1.27930.21511820.31380.91030.38220.9076
1.27930.21751840.31450.90700.40740.9027
1.24450.21991860.31580.90370.35330.9044
1.24450.22221880.31580.91360.38840.9137
1.25270.22461900.31380.90030.41060.8993
1.25270.22701920.31510.90370.40700.9014
1.25270.22931940.31450.90700.41700.9053
1.26330.23171960.31380.91360.41550.9129
1.26330.23401980.31320.91360.38230.9132
1.24450.23642000.31320.91360.35530.9132
1.24450.23882020.31250.91360.35230.9148
1.24450.24112040.31250.91360.35230.9148
1.25430.24352060.31120.91690.38640.9138
1.25430.24592080.31120.90700.48710.9052
1.25270.24822100.31250.92690.56740.9270
1.25270.25062120.31320.92690.60780.9251
1.25270.25302140.31320.93020.62190.9308
1.27890.25532160.31510.93020.62790.9319
1.27890.25772180.31380.92360.54090.9226
1.25550.26002200.31120.91360.53270.9119
1.25550.26242220.30990.92690.62430.9277
1.25550.26482240.31120.93020.53890.9289
1.25040.26712260.31120.93020.53150.9282
1.25040.26952280.31050.93360.53500.9310
1.22730.27192300.30920.93690.54330.9350
1.22730.27422320.30920.93020.53770.9272
1.22730.27662340.31180.92690.52780.9226
1.22270.27902360.31510.92690.48760.9245
1.22270.28132380.31580.92690.41960.9242
1.23950.28372400.31640.93360.44000.9322
1.23950.28612420.31450.91690.32300.9169
1.23950.28842440.31450.91030.32160.9112
1.2160.29082460.31380.90700.32100.9077
1.2160.29312480.31450.93020.33210.9299
1.23830.29552500.31450.91690.30940.9203
1.23830.29792520.31180.92360.36430.9267
1.23830.30022540.31120.92030.35230.9232
1.23520.30262560.30990.92360.29700.9220
1.23520.30502580.30920.92690.38970.9254
1.26880.30732600.31120.92360.34980.9200
1.26880.30972620.30860.92690.54940.9272
1.26880.31212640.30990.92360.42170.9268
1.24410.31442660.30860.92360.35170.9215
1.24410.31682680.30920.91360.34070.9088
1.23750.31912700.30920.91690.26480.9105
1.23750.32152720.30860.92690.35040.9231
1.23750.32392740.30860.92030.34920.9163
1.25630.32622760.30790.93360.47630.9305
1.25630.32862780.30790.93020.47580.9274
1.25080.33102800.30790.93690.48210.9340
1.25080.33332820.30660.94350.47830.9404
1.25080.33572840.30660.94020.38210.9426
1.2180.33812860.30730.91030.39740.9139
1.2180.34042880.30790.92030.37110.9258
1.2270.34282900.30860.92030.37550.9260
1.2270.34522920.30990.92360.35140.9293
1.2270.34752940.30790.93360.33860.9324
1.2230.34992960.30530.93020.33210.9299
1.2230.35222980.30530.91690.32480.9170
1.22580.35463000.30660.92030.45950.9195
1.22580.35703020.30790.93020.43120.9304
1.22580.35933040.30920.93360.55050.9337
1.22230.36173060.30920.93690.51170.9381
1.22230.36413080.30860.94020.44220.9390
1.21760.36643100.30860.93360.44000.9320
1.21760.36883120.30660.91690.33880.9151
1.21760.37123140.30660.91030.30170.9093
1.24060.37353160.30600.92030.29980.9197
1.24060.37593180.30600.90700.29240.9077
1.22730.37833200.30400.92030.30270.9225
1.22730.38063220.30340.92360.32910.9239
1.22730.38303240.30470.92360.37680.9261
1.21050.38533260.30340.92360.37000.9278
1.21050.38773280.30340.93360.35110.9385
1.21020.39013300.30400.92360.34400.9302
1.21020.39243320.30600.92360.34840.9294
1.21020.39483340.30600.92690.30880.9304
1.2230.39723360.30600.93360.31320.9357
1.2230.39953380.30660.93020.31240.9303
1.22230.40193400.30730.92360.30270.9237
1.22230.40433420.30790.91690.31180.9150
1.22230.40663440.30920.92030.32400.9196
1.19650.40903460.30920.91690.32100.9168
1.19650.41133480.30920.92360.32410.9236
1.21760.41373500.30990.91360.29790.9150
1.21760.41613520.30920.92360.30440.9241
1.21760.41843540.30790.92030.30000.9228
1.23010.42083560.30730.92030.30250.9225
1.23010.42323580.30660.91690.29610.9199
1.19920.42553600.30600.92030.34050.9243
1.19920.42793620.30530.91690.29610.9198
1.19920.43033640.30400.91690.22050.9200
1.19690.43263660.30470.92030.22410.9219
1.19690.43503680.30470.92360.30570.9252
1.21840.43743700.30470.92360.30570.9252
1.21840.43973720.30340.92030.30250.9223
1.21840.44213740.30400.92360.30300.9257
1.18710.44443760.30400.92030.29610.9245
1.18710.44683780.30400.92690.30110.9296
1.22540.44923800.30400.92360.30300.9257
1.22540.45153820.30400.91690.23560.9173
1.22540.45393840.30400.91690.23560.9172
1.22030.45633860.30270.92030.22570.9208
1.22030.45863880.30270.92690.28650.9296
1.21990.46103900.30400.92360.28600.9265
1.21990.46343920.30470.92360.34830.9281
1.21990.46573940.30400.92690.32760.9308
1.23670.46813960.30340.92360.26730.9252
1.23670.47043980.30340.92690.28570.9285
1.19450.47284000.30340.92690.34740.9301
1.19450.47524020.30340.93020.37330.9336
1.19450.47754040.30340.93020.37330.9336
1.21370.47994060.30400.93020.37330.9336
1.21370.48234080.30340.92690.37280.9302
1.19180.48464100.30340.92690.37280.9302
1.19180.48704120.30400.93360.44720.9363
1.19180.48944140.30340.92360.37150.9251
1.20230.49174160.30340.93020.44660.9330
1.20230.49414180.30270.93690.44780.9397
1.19380.49654200.30400.93020.44670.9331
1.19380.49884220.30470.92690.44310.9302
1.19380.50124240.30340.93020.30630.9302
1.22460.50354260.30340.93020.30630.9302
1.22460.50594280.30340.93360.30680.9335
1.19960.50834300.30210.93360.35550.9324
1.19960.51064320.29950.92690.46000.9268
1.19960.51304340.29880.92690.53830.9296
1.18320.51544360.29950.93360.62260.9379
1.18320.51774380.30010.93020.61530.9342
1.21170.52014400.30010.93020.62190.9345
1.21170.52254420.30010.93690.50330.9398
1.21170.52484440.30010.93360.42690.9338
1.20.52724460.30010.92690.44310.9302
1.20.52964480.30140.92690.44310.9302
1.18790.53194500.30270.93020.62800.9356
1.18790.53434520.30270.93360.63150.9384
1.18790.53664540.30210.92690.44330.9302
1.19730.53904560.30270.92690.49840.9304
1.19730.54144580.30140.92690.34390.9278
1.20390.54374600.30140.92690.34390.9278
1.20390.54614620.30140.92690.40060.9292
1.20390.54854640.30140.92690.40050.9269
1.16840.55084660.30080.93360.44440.9369
1.16840.55324680.30080.93360.44420.9353
1.21640.55564700.30140.93690.44160.9386
1.21640.55794720.30080.93360.43840.9358
1.21640.56034740.29950.93360.44420.9352
1.23630.56264760.29880.93020.44640.9314
1.23630.56504780.29880.93020.47720.9301
1.19450.56744800.29880.92690.30700.9246
1.19450.56974820.29820.92690.26910.9278
1.19450.57214840.29820.93690.45100.9378
1.21210.57454860.30010.94020.45170.9428
1.21210.57684880.30080.93360.41370.9403
1.19840.57924900.30340.93360.57880.9393
1.19840.58164920.30210.94350.62850.9475
1.19840.58394940.30080.93690.62710.9409
1.19410.58634960.30010.94020.62780.9441
1.19410.58874980.30010.93690.62320.9410
1.18750.59105000.30010.93690.62320.9410
1.18750.59345020.30010.94020.62780.9441
1.18750.59575040.30010.93690.62320.9410
1.1930.59815060.29950.93360.61920.9381
1.1930.60055080.29950.93020.61280.9360
1.21170.60285100.29880.93360.61890.9394
1.21170.60525120.29950.93360.69900.9400
1.21170.60765140.29820.93360.69900.9400
1.19060.60995160.29820.94020.70940.9442
1.19060.61235180.29820.94020.68180.9437
1.18240.61475200.29820.94350.68920.9464
1.18240.61705220.29880.94020.68600.9437
1.18240.61945240.29880.94020.68600.9437
1.1840.62175260.30010.93690.59640.9396
1.1840.62415280.30080.93690.59640.9396
1.17970.62655300.30080.93690.59640.9396
1.17970.62885320.30010.93360.54650.9379
1.17970.63125340.30010.93690.55290.9420
1.19220.63365360.29950.93690.55020.9413
1.19220.63595380.29950.93690.61820.9400
1.21250.63835400.30010.93360.61280.9378
1.21250.64075420.29950.93690.60900.9399
1.21250.64305440.29950.93690.61250.9395
1.19920.64545460.29820.94350.67430.9434
1.19920.64785480.29880.94350.67520.9424
1.20860.65015500.29820.94020.55310.9426
1.20860.65255520.29820.93690.54950.9397
1.20860.65485540.29690.93360.54630.9370
1.20430.65725560.29750.93360.54960.9379
1.20430.65965580.29820.93690.55520.9413
1.21250.66195600.29750.93690.51550.9413
1.21250.66435620.29750.93690.51550.9413
1.21250.66675640.29750.93690.51550.9413
1.19020.66905660.29750.93360.55460.9380
1.19020.67145680.29750.93360.55460.9380
1.20630.67385700.29750.93020.54900.9346
1.20630.67615720.29690.93690.57770.9396
1.20630.67855740.29690.93690.57770.9396
1.18520.68095760.29750.92690.50620.9305
1.18520.68325780.29750.92690.40630.9304
1.19490.68565800.29820.93020.40680.9337
1.19490.68795820.29820.93360.50970.9363
1.19490.69035840.29820.94020.55260.9409
1.21520.69275860.29820.94020.55260.9409
1.21520.69505880.29820.94020.55280.9409
1.19920.69745900.29820.93360.51250.9359
1.19920.69985920.29820.93690.51310.9393
1.19920.70215940.29750.93690.51310.9393
1.21410.70455960.29750.94350.51420.9460
1.21410.70695980.29750.94350.57580.9454
1.19840.70926000.29690.94020.57260.9427
1.19840.71166020.29690.93690.57200.9393
1.19840.71396040.29750.93690.57200.9393
1.19690.71636060.29690.93690.58060.9390
1.19690.71876080.29750.94350.63890.9437
1.18590.72106100.29690.94020.63470.9407
1.18590.72346120.29750.93690.50890.9374
1.18590.72586140.29750.94020.50950.9407
1.19840.72816160.29750.93690.50890.9374
1.19840.73056180.29750.93360.44880.9352
1.18790.73296200.29690.93360.52000.9368
1.18790.73526220.29750.94350.56480.9449
1.18790.73766240.29750.94020.51920.9430
1.18870.74006260.29750.94020.55260.9410
1.18870.74236280.29750.94350.55320.9444
1.17070.74476300.29820.94680.55730.9474
1.17070.74706320.29820.94680.56000.9481
1.17070.74946340.29820.94680.56000.9481
1.19690.75186360.29820.94020.45300.9416
1.19690.75416380.29820.93690.45240.9382
1.17190.75656400.29820.94020.56420.9415
1.17190.75896420.29820.94350.56480.9449
1.17190.76126440.29820.94020.55880.9414
1.20230.76366460.29820.94350.55940.9448
1.20230.76606480.29820.94350.55940.9448
1.18590.76836500.29690.94350.55940.9448
1.18590.77076520.29750.94350.55940.9448
1.18590.77306540.29750.95020.56420.9512
1.16290.77546560.29750.94020.51630.9435
1.16290.77786580.29750.94350.51980.9464
1.18870.78016600.29690.94680.56000.9481
1.18870.78256620.29690.95020.56420.9512
1.18870.78496640.29620.94680.60670.9481
1.18050.78726660.29620.95020.61120.9511
1.18050.78966680.29620.95020.61120.9511
1.20310.79206700.29620.94680.61060.9477
1.20310.79436720.29490.94680.61030.9461
1.20310.79676740.29490.95020.69640.9499
1.1840.79916760.29560.95020.69640.9499
1.1840.80146780.29560.94680.68680.9483
1.19450.80386800.29560.94350.68230.9455
1.19450.80616820.29560.94020.68160.9421
1.19450.80856840.29560.94350.68230.9455
1.20310.81096860.29560.94350.68230.9455
1.20310.81326880.29620.94680.68300.9489
1.18750.81566900.29620.94680.68300.9489
1.18750.81806920.29620.94350.68230.9455
1.18750.82036940.29620.94680.68930.9489
1.16990.82276960.29620.94680.68930.9489
1.16990.82516980.29620.94680.68930.9489
1.20350.82747000.29620.94680.68920.9488
1.20350.82987020.29560.94350.68500.9460
1.20350.83227040.29620.94350.68500.9460
1.21130.83457060.29620.94350.68500.9460
1.21130.83697080.29620.94350.68500.9460
1.16840.83927100.29620.94350.68500.9460
1.16840.84167120.29620.94680.68920.9488
1.16840.84407140.29620.94350.68500.9460
1.14730.84637160.29620.94680.68920.9488
1.14730.84877180.29620.94020.62770.9443
1.16840.85117200.29690.94350.62840.9477
1.16840.85347220.29620.94350.68210.9467
1.16840.85587240.29560.94020.62500.9450
1.18710.85827260.29620.94020.62500.9450
1.18710.86057280.29560.94020.62500.9450
1.18590.86297300.29560.94020.62500.9450
1.18590.86527320.29560.94020.62500.9450
1.18590.86767340.29560.94020.62500.9450
1.18480.87007360.29560.93690.62440.9416
1.18480.87237380.29560.93690.62440.9416
1.17850.87477400.29560.93690.62440.9416
1.17850.87717420.29560.93690.62440.9416
1.17850.87947440.29560.93360.62370.9383
1.18670.88187460.29560.93360.62370.9383
1.18670.88427480.29560.94020.62920.9435
1.16640.88657500.29560.93690.62860.9402
1.16640.88897520.29560.93360.62370.9383
1.16640.89137540.29560.93690.62860.9402
1.16020.89367560.29560.93690.62860.9402
1.16020.89607580.29560.93690.62860.9402
1.15940.89837600.29560.93690.62860.9402
1.15940.90077620.29560.93360.55460.9380
1.15940.90317640.29560.93360.55460.9380
1.18980.90547660.29560.93360.55460.9380
1.18980.90787680.29560.93360.55460.9380
1.17380.91027700.29560.93360.55460.9380
1.17380.91257720.29560.93360.55460.9380
1.17380.91497740.29560.93360.55460.9380
1.18830.91737760.29560.93690.55790.9407
1.18830.91967780.29560.93360.55460.9380
1.16840.92207800.29560.93690.55520.9413
1.16840.92437820.29560.93690.55790.9407
1.16840.92677840.29560.93360.55460.9380
1.1680.92917860.29560.94350.56200.9469
1.1680.93147880.29560.93690.55790.9407
1.16910.93387900.29560.94020.56140.9436
1.16910.93627920.29560.94020.56140.9436
1.16910.93857940.29560.93690.55790.9407
1.16990.94097960.29560.93690.55790.9407
1.16990.94337980.29560.93360.55460.9380
1.17270.94568000.29560.94020.55840.9440
1.17270.94808020.29560.93690.55790.9407
1.17270.95048040.29560.94350.63600.9458
1.19060.95278060.29560.93360.55460.9380
1.19060.95518080.29560.94350.63600.9458
1.20310.95748100.29560.94350.63600.9458
1.20310.95988120.29560.93690.55790.9407
1.20310.96228140.29560.94350.56200.9469
1.18360.96458160.29560.94020.55840.9440
1.18360.96698180.29560.93690.55790.9407
1.20390.96938200.29560.93690.55520.9413
1.20390.97168220.29560.93690.55790.9407
1.20390.97408240.29560.94020.55840.9440
1.17850.97648260.29560.94020.56140.9436
1.17850.97878280.29560.94020.56140.9436
1.16020.98118300.29560.94020.63210.9430
1.16020.98358320.29560.94020.56140.9436
1.16020.98588340.29560.94020.56140.9436
1.20120.98828360.29560.94020.63210.9430
1.20120.99058380.29560.94020.63210.9430
1.18240.99298400.29560.94020.63210.9430
1.18240.99538420.29560.94020.63210.9430
1.18240.99768440.29560.94020.63210.9430
1.17661.08460.29560.94350.63600.9458

Framework versions

  • —PEFT 0.18.1
  • —Transformers 4.51.0
  • —Pytorch 2.8.0+cu128
  • —Datasets 3.6.0
  • —Tokenizers 0.21.0