CoolFace
Modelpublic

JEdward7777/2-finetuned-xlm-r-masakhaner-swa-whole-word-phonetic

sourceHugging Facemitupdated 4y agoView on Hugging Face
0likes99downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

2-finetuned-xlm-r-masakhaner-swa-whole-word-phonetic

This model is a fine-tuned version of xlm-roberta-base on the None dataset. It achieves the following results on the evaluation set:

  • —Loss: 11.0492

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 5e-08
  • —trainbatchsize: 1
  • —evalbatchsize: 8
  • —seed: 42
  • —gradientaccumulationsteps: 8
  • —totaltrainbatch_size: 8
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —num_epochs: 500

Training results

Training LossEpochStepValidation Loss
No log1.06139.7928
No log2.012239.8195
No log3.018339.8228
No log4.024439.0793
No log5.030538.6628
No log6.036637.4014
No log7.042736.8203
No log8.048836.2607
41.04369.054935.9316
41.043610.061034.3282
41.043611.067133.3604
41.043612.073232.4470
41.043613.079331.5403
41.043614.085430.9665
41.043615.091529.4171
41.043616.097628.4589
32.550617.0103727.2699
32.550618.0109826.0614
32.550619.0115925.1529
32.550620.0122024.3080
32.550621.0128123.1511
32.550622.0134222.3332
32.550623.0140321.7154
32.550624.0146420.7367
24.321225.0152520.1804
24.321226.0158619.5591
24.321227.0164718.8760
24.321228.0170818.3291
24.321229.0176918.0296
24.321230.0183017.4091
24.321231.0189117.2150
24.321232.0195216.6483
18.566233.0201316.2697
18.566234.0207416.1714
18.566235.0213515.8008
18.566236.0219615.2647
18.566237.0225715.4195
18.566238.0231814.9898
18.566239.0237914.8599
18.566240.0244014.6119
15.114141.0250114.4644
15.114142.0256214.3398
15.114143.0262314.4107
15.114144.0268413.9039
15.114145.0274514.0043
15.114146.0280613.9534
15.114147.0286713.9267
15.114148.0292813.5888
15.114149.0298913.6313
13.18250.0305013.5405
13.18251.0311113.3378
13.18252.0317213.3160
13.18253.0323313.1356
13.18254.0329413.2483
13.18255.0335513.1259
13.18256.0341613.1775
13.18257.0347713.1118
12.171258.0353812.9363
12.171259.0359912.8765
12.171260.0366012.7923
12.171261.0372112.9732
12.171262.0378212.8606
12.171263.0384312.7897
12.171264.0390412.6516
12.171265.0396512.6242
11.585366.0402612.5954
11.585367.0408712.4505
11.585368.0414812.5595
11.585369.0420912.4287
11.585370.0427012.4768
11.585371.0433112.4003
11.585372.0439212.4323
11.585373.0445312.4179
11.2574.0451412.3767
11.2575.0457512.4342
11.2576.0463612.2565
11.2577.0469712.3128
11.2578.0475812.3749
11.2579.0481912.3565
11.2580.0488012.3288
11.2581.0494112.2014
11.003882.0500212.1772
11.003883.0506312.2690
11.003884.0512412.1987
11.003885.0518512.0654
11.003886.0524612.1295
11.003887.0530712.1560
11.003888.0536811.9662
11.003889.0542912.1134
11.003890.0549012.0294
10.828391.0555112.1112
10.828392.0561212.0910
10.828393.0567312.0087
10.828394.0573411.9803
10.828395.0579511.9094
10.828396.0585612.1592
10.828397.0591711.9361
10.828398.0597811.9596
10.69399.0603911.9026
10.693100.0610012.0040
10.693101.0616111.8866
10.693102.0622211.9536
10.693103.0628311.8034
10.693104.0634411.6885
10.693105.0640511.8505
10.693106.0646611.8280
10.5875107.0652711.7874
10.5875108.0658811.7348
10.5875109.0664911.7765
10.5875110.0671011.7527
10.5875111.0677111.6816
10.5875112.0683211.7396
10.5875113.0689311.6475
10.5875114.0695411.7010
10.5114115.0701511.7049
10.5114116.0707611.7967
10.5114117.0713711.7248
10.5114118.0719811.6549
10.5114119.0725911.5194
10.5114120.0732011.6924
10.5114121.0738111.5194
10.5114122.0744211.6607
10.4791123.0750311.5189
10.4791124.0756411.5525
10.4791125.0762511.5226
10.4791126.0768611.4954
10.4791127.0774711.5944
10.4791128.0780811.7056
10.4791129.0786911.7464
10.4791130.0793011.4851
10.4791131.0799111.3106
10.4223132.0805211.6615
10.4223133.0811311.5130
10.4223134.0817411.5866
10.4223135.0823511.4999
10.4223136.0829611.5736
10.4223137.0835711.6101
10.4223138.0841811.6018
10.4223139.0847911.5062
10.3725140.0854011.4695
10.3725141.0860111.5745
10.3725142.0866211.2131
10.3725143.0872311.4861
10.3725144.0878411.3521
10.3725145.0884511.4302
10.3725146.0890611.3891
10.3725147.0896711.4948
10.3579148.0902811.4140
10.3579149.0908911.2809
10.3579150.0915011.5084
10.3579151.0921111.4942
10.3579152.0927211.4316
10.3579153.0933311.5054
10.3579154.0939411.4354
10.3579155.0945511.3708
10.3411156.0951611.6017
10.3411157.0957711.4415
10.3411158.0963811.6150
10.3411159.0969911.3789
10.3411160.0976011.3342
10.3411161.0982111.4761
10.3411162.0988211.3000
10.3411163.0994311.4109
10.3236164.01000411.4250
10.3236165.01006511.3250
10.3236166.01012611.4247
10.3236167.01018711.1662
10.3236168.01024811.4494
10.3236169.01030911.3871
10.3236170.01037011.2961
10.3236171.01043111.3576
10.3236172.01049211.4350
10.3059173.01055311.3612
10.3059174.01061411.3979
10.3059175.01067511.3716
10.3059176.01073611.4017
10.3059177.01079711.5342
10.3059178.01085811.2274
10.3059179.01091911.4326
10.3059180.01098011.4779
10.2637181.01104111.3424
10.2637182.01110211.2459
10.2637183.01116311.3178
10.2637184.01122411.3254
10.2637185.01128511.2635
10.2637186.01134611.2145
10.2637187.01140711.3280
10.2637188.01146811.3373
10.2837189.01152911.1808
10.2837190.01159011.2220
10.2837191.01165111.1251
10.2837192.01171211.3569
10.2837193.01177311.1888
10.2837194.01183411.2572
10.2837195.01189511.3158
10.2837196.01195611.2948
10.2404197.01201711.2186
10.2404198.01207811.2823
10.2404199.01213911.2506
10.2404200.01220011.5542
10.2404201.01226111.3140
10.2404202.01232211.2008
10.2404203.01238311.1571
10.2404204.01244411.2337
10.2304205.01250511.2708
10.2304206.01256611.3081
10.2304207.01262711.1103
10.2304208.01268811.1240
10.2304209.01274911.3450
10.2304210.01281011.0590
10.2304211.01287111.2573
10.2304212.01293211.2076
10.2304213.01299311.1813
10.2405214.01305411.3382
10.2405215.01311511.4096
10.2405216.01317611.1521
10.2405217.01323711.3125
10.2405218.01329811.1917
10.2405219.01335911.2792
10.2405220.01342011.1236
10.2405221.01348111.2397
10.2096222.01354211.1875
10.2096223.01360311.3117
10.2096224.01366411.1565
10.2096225.01372511.4165
10.2096226.01378611.1474
10.2096227.01384710.9854
10.2096228.01390811.1346
10.2096229.01396911.2123
10.1998230.01403011.2454
10.1998231.01409111.3353
10.1998232.01415211.3052
10.1998233.01421311.1773
10.1998234.01427411.1327
10.1998235.01433511.3109
10.1998236.01439611.1788
10.1998237.01445711.3767
10.1947238.01451811.2157
10.1947239.01457911.2102
10.1947240.01464011.1842
10.1947241.01470111.1392
10.1947242.01476211.1399
10.1947243.01482311.1630
10.1947244.01488411.1972
10.1947245.01494511.0548
10.1922246.01500611.1279
10.1922247.01506711.0969
10.1922248.01512811.2348
10.1922249.01518911.1151
10.1922250.01525011.5368
10.1922251.01531111.2244
10.1922252.01537211.2102
10.1922253.01543311.2735
10.1922254.01549411.3227
10.1994255.01555511.2377
10.1994256.01561611.2835
10.1994257.01567711.3475
10.1994258.01573811.2092
10.1994259.01579911.1936
10.1994260.01586011.0319
10.1994261.01592111.1916
10.1994262.01598211.1357
10.1883263.01604310.9732
10.1883264.01610411.1839
10.1883265.01616511.0701
10.1883266.01622611.1613
10.1883267.01628711.1302
10.1883268.01634811.0951
10.1883269.01640911.0579
10.1883270.01647011.1459
10.1863271.01653111.1969
10.1863272.01659211.1275
10.1863273.01665311.1115
10.1863274.01671411.1285
10.1863275.01677511.1053
10.1863276.01683611.0105
10.1863277.01689711.1378
10.1863278.01695811.0771
10.1614279.01701911.0620
10.1614280.01708010.9906
10.1614281.01714111.0771
10.1614282.01720211.0357
10.1614283.01726311.0417
10.1614284.01732411.0287
10.1614285.01738511.1172
10.1614286.01744610.9257
10.1717287.01750711.2312
10.1717288.01756811.3800
10.1717289.01762911.1386
10.1717290.01769011.1724
10.1717291.01775111.1628
10.1717292.01781211.1226
10.1717293.01787311.1955
10.1717294.01793411.1388
10.1717295.01799511.0874
10.1806296.01805611.0813
10.1806297.01811711.1475
10.1806298.01817811.1678
10.1806299.01823911.2450
10.1806300.01830011.1936
10.1806301.01836111.1021
10.1806302.01842211.1874
10.1806303.01848311.1719
10.1683304.01854411.1554
10.1683305.01860511.0771
10.1683306.01866611.0676
10.1683307.01872711.1280
10.1683308.01878811.0236
10.1683309.01884911.1440
10.1683310.01891011.1843
10.1683311.01897111.0474
10.1437312.01903211.0391
10.1437313.01909310.9148
10.1437314.01915411.0575
10.1437315.01921511.1955
10.1437316.01927611.0053
10.1437317.01933711.0810
10.1437318.01939811.1360
10.1437319.01945911.2291
10.1539320.01952011.0239
10.1539321.01958111.1216
10.1539322.01964211.2516
10.1539323.01970310.9759
10.1539324.01976411.0398
10.1539325.01982511.0431
10.1539326.01988610.9151
10.1539327.01994711.0905
10.1432328.02000811.0099
10.1432329.02006911.0893
10.1432330.02013011.1344
10.1432331.02019111.0682
10.1432332.02025210.9558
10.1432333.02031311.0669
10.1432334.02037411.0556
10.1432335.02043511.2097
10.1432336.02049611.0200
10.1343337.02055710.9683
10.1343338.02061810.9824
10.1343339.02067911.1563
10.1343340.02074011.1489
10.1343341.02080111.1389
10.1343342.02086211.1128
10.1343343.02092311.0437
10.1343344.02098411.1005
10.143345.02104511.1696
10.143346.02110611.1356
10.143347.02116711.0798
10.143348.02122810.9183
10.143349.02128911.0879
10.143350.02135010.9651
10.143351.02141111.0724
10.143352.02147211.0264
10.1456353.02153311.1398
10.1456354.02159411.2497
10.1456355.02165510.8898
10.1456356.02171610.9631
10.1456357.02177711.0734
10.1456358.02183811.1226
10.1456359.02189911.1686
10.1456360.02196011.0314
10.1345361.02202111.0940
10.1345362.02208210.9222
10.1345363.02214311.1036
10.1345364.02220411.1905
10.1345365.02226510.9741
10.1345366.02232610.9092
10.1345367.02238711.0564
10.1345368.02244811.0534
10.1354369.02250911.0307
10.1354370.02257011.1469
10.1354371.02263111.0560
10.1354372.02269211.0240
10.1354373.02275310.9869
10.1354374.02281411.0004
10.1354375.02287511.1373
10.1354376.02293611.0955
10.1354377.02299711.0542
10.1382378.02305810.9813
10.1382379.02311910.9874
10.1382380.02318010.9736
10.1382381.02324111.1295
10.1382382.02330210.8724
10.1382383.02336310.9367
10.1382384.02342411.0516
10.1382385.02348511.0275
10.1246386.02354611.0184
10.1246387.02360711.0570
10.1246388.02366811.0246
10.1246389.02372911.0131
10.1246390.02379011.0168
10.1246391.02385111.0817
10.1246392.02391210.8949
10.1246393.02397310.7698
10.1173394.02403411.0041
10.1173395.02409510.9257
10.1173396.02415610.9295
10.1173397.02421710.9476
10.1173398.02427811.0583
10.1173399.02433911.0006
10.1173400.02440010.9714
10.1173401.02446111.0480
10.1253402.02452211.0213
10.1253403.02458310.9636
10.1253404.02464410.9886
10.1253405.02470511.0664
10.1253406.02476611.0462
10.1253407.02482711.0122
10.1253408.02488810.8572
10.1253409.02494911.1382
10.1386410.02501011.0700
10.1386411.02507110.9676
10.1386412.02513211.1865
10.1386413.02519311.0785
10.1386414.02525411.0290
10.1386415.02531511.1383
10.1386416.02537611.1139
10.1386417.02543711.0185
10.1386418.02549811.0187
10.1491419.02555911.0893
10.1491420.02562011.0348
10.1491421.02568110.9932
10.1491422.02574211.0765
10.1491423.02580311.0488
10.1491424.02586411.0241
10.1491425.02592511.0695
10.1491426.02598610.8986
10.1184427.02604710.8433
10.1184428.02610810.8476
10.1184429.02616910.9747
10.1184430.02623010.9259
10.1184431.02629110.8647
10.1184432.02635211.0280
10.1184433.02641310.9582
10.1184434.02647410.9810
10.1396435.02653511.0491
10.1396436.02659611.0700
10.1396437.02665710.9878
10.1396438.02671810.9400
10.1396439.02677910.8682
10.1396440.02684010.9667
10.1396441.02690111.0117
10.1396442.02696211.0374
10.1337443.02702311.1337
10.1337444.02708410.9415
10.1337445.02714511.0174
10.1337446.02720611.0239
10.1337447.02726710.8979
10.1337448.02732810.9217
10.1337449.02738910.8926
10.1337450.02745011.1219
10.1168451.02751110.8931
10.1168452.02757211.0112
10.1168453.02763310.9823
10.1168454.02769411.1091
10.1168455.02775510.8694
10.1168456.02781610.9625
10.1168457.02787710.8553
10.1168458.02793810.9888
10.1168459.02799910.9296
10.1229460.02806010.8895
10.1229461.02812110.9803
10.1229462.02818211.0144
10.1229463.02824311.0257
10.1229464.02830410.9141
10.1229465.02836511.1346
10.1229466.02842611.0254
10.1229467.02848711.0384
10.1179468.02854810.8491
10.1179469.02860911.0469
10.1179470.02867010.9678
10.1179471.02873110.8902
10.1179472.02879210.9649
10.1179473.02885310.9252
10.1179474.02891411.1131
10.1179475.02897511.0267
10.1189476.02903610.8428
10.1189477.02909711.0314
10.1189478.02915811.0936
10.1189479.02921910.9968
10.1189480.02928010.8721
10.1189481.02934111.0153
10.1189482.02940211.1761
10.1189483.02946310.9840
10.1153484.02952410.9648
10.1153485.02958511.1140
10.1153486.02964611.0212
10.1153487.02970710.9197
10.1153488.02976810.9798
10.1153489.02982910.9047
10.1153490.02989011.0146
10.1153491.02995111.0575
10.1141492.03001211.0400
10.1141493.03007311.0898
10.1141494.03013410.9910
10.1141495.03019511.0579
10.1141496.03025610.8580
10.1141497.03031710.9450
10.1141498.03037811.0523
10.1141499.03043911.1228
10.1176500.03050011.0492

Framework versions

  • —Transformers 4.20.1
  • —Pytorch 1.11.0
  • —Datasets 2.1.0
  • —Tokenizers 0.12.1