Modelpublic

MayBashendy/Arabic_FineTuningAraBERT_AugV5_k10_task3_organization_fold1

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes11downloads

Model Card

ArabicFineTuningAraBERTAugV5k10task3organizationfold1

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

—Loss: 0.4207
—Qwk: 0.4444
—Mse: 0.4207
—Rmse: 0.6486

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 2e-05
—trainbatchsize: 8
—evalbatchsize: 8
—seed: 42
—optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
—lrschedulertype: linear
—num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0444	2	4.5873	0.0	4.5873	2.1418
No log	0.0889	4	2.8879	-0.0331	2.8879	1.6994
No log	0.1333	6	1.5939	0.0	1.5939	1.2625
No log	0.1778	8	1.0368	0.1437	1.0368	1.0182
No log	0.2222	10	1.0340	0.0	1.0340	1.0169
No log	0.2667	12	1.2855	0.0	1.2855	1.1338
No log	0.3111	14	1.5445	0.0	1.5445	1.2428
No log	0.3556	16	1.4286	0.0	1.4286	1.1952
No log	0.4	18	1.3724	0.0	1.3724	1.1715
No log	0.4444	20	1.3301	0.0	1.3301	1.1533
No log	0.4889	22	0.9246	-0.2550	0.9246	0.9616
No log	0.5333	24	0.8546	-0.2655	0.8546	0.9245
No log	0.5778	26	1.0529	-0.2515	1.0529	1.0261
No log	0.6222	28	1.3397	0.0	1.3397	1.1574
No log	0.6667	30	1.4524	0.0	1.4524	1.2051
No log	0.7111	32	1.4296	0.0	1.4296	1.1957
No log	0.7556	34	1.2875	0.0	1.2875	1.1347
No log	0.8	36	0.9484	0.0	0.9484	0.9738
No log	0.8444	38	0.9163	0.0	0.9163	0.9572
No log	0.8889	40	0.8605	0.1646	0.8605	0.9276
No log	0.9333	42	1.0778	0.0	1.0778	1.0382
No log	0.9778	44	1.1478	0.0	1.1478	1.0713
No log	1.0222	46	0.9090	0.0	0.9090	0.9534
No log	1.0667	48	0.8062	0.3038	0.8062	0.8979
No log	1.1111	50	0.7755	-0.0820	0.7755	0.8806
No log	1.1556	52	0.8495	-0.0577	0.8495	0.9217
No log	1.2	54	1.0310	-0.4027	1.0310	1.0154
No log	1.2444	56	0.8215	-0.1000	0.8215	0.9064
No log	1.2889	58	0.8783	0.1646	0.8783	0.9372
No log	1.3333	60	1.0236	0.0	1.0236	1.0117
No log	1.3778	62	1.0528	0.0	1.0528	1.0261
No log	1.4222	64	0.8918	0.0	0.8918	0.9444
No log	1.4667	66	0.7301	-0.0233	0.7301	0.8545
No log	1.5111	68	0.7057	-0.0577	0.7057	0.8401
No log	1.5556	70	0.7746	0.3356	0.7746	0.8801
No log	1.6	72	0.8583	0.3038	0.8583	0.9265
No log	1.6444	74	0.8472	0.3038	0.8472	0.9204
No log	1.6889	76	0.7202	0.0763	0.7202	0.8487
No log	1.7333	78	0.7396	0.0763	0.7396	0.8600
No log	1.7778	80	1.0645	0.0	1.0645	1.0318
No log	1.8222	82	1.2956	0.0	1.2956	1.1382
No log	1.8667	84	1.1869	0.0	1.1869	1.0894
No log	1.9111	86	0.9278	0.0	0.9278	0.9632
No log	1.9556	88	0.7599	0.1239	0.7599	0.8717
No log	2.0	90	0.6576	0.0	0.6576	0.8109
No log	2.0444	92	0.6596	0.0	0.6596	0.8121
No log	2.0889	94	0.6836	0.0	0.6836	0.8268
No log	2.1333	96	0.7377	-0.0421	0.7377	0.8589
No log	2.1778	98	0.8238	0.1646	0.8238	0.9076
No log	2.2222	100	1.0253	0.0	1.0253	1.0126
No log	2.2667	102	1.0933	0.0	1.0933	1.0456
No log	2.3111	104	1.0143	0.0	1.0143	1.0071
No log	2.3556	106	0.8246	0.3038	0.8246	0.9081
No log	2.4	108	0.7135	0.3714	0.7135	0.8447
No log	2.4444	110	0.5600	0.5769	0.5600	0.7483
No log	2.4889	112	0.4641	0.0	0.4641	0.6813
No log	2.5333	114	0.4950	-0.0233	0.4950	0.7036
No log	2.5778	116	0.8925	0.0253	0.8925	0.9447
No log	2.6222	118	1.3082	0.0	1.3082	1.1438
No log	2.6667	120	1.4336	0.0	1.4336	1.1973
No log	2.7111	122	1.3156	0.0	1.3156	1.1470
No log	2.7556	124	1.1090	0.0	1.1090	1.0531
No log	2.8	126	0.8548	0.1437	0.8548	0.9245
No log	2.8444	128	0.6539	0.0	0.6539	0.8086
No log	2.8889	130	0.5944	0.0	0.5944	0.7710
No log	2.9333	132	0.5857	0.0	0.5857	0.7653
No log	2.9778	134	0.5968	0.0	0.5968	0.7726
No log	3.0222	136	0.6426	0.0	0.6426	0.8016
No log	3.0667	138	0.7252	0.1895	0.7252	0.8516
No log	3.1111	140	0.7634	0.0984	0.7634	0.8737
No log	3.1556	142	0.8541	0.1437	0.8541	0.9242
No log	3.2	144	0.9033	0.1437	0.9033	0.9504
No log	3.2444	146	0.9030	0.1437	0.9030	0.9503
No log	3.2889	148	0.9210	0.1437	0.9210	0.9597
No log	3.3333	150	0.7059	0.1239	0.7059	0.8402
No log	3.3778	152	0.5635	0.1895	0.5635	0.7507
No log	3.4222	154	0.4876	0.2326	0.4876	0.6983
No log	3.4667	156	0.4612	0.0	0.4612	0.6791
No log	3.5111	158	0.4943	0.0	0.4943	0.7030
No log	3.5556	160	0.6209	0.1239	0.6209	0.7880
No log	3.6	162	1.8664	0.0797	1.8664	1.3662
No log	3.6444	164	2.2401	0.0435	2.2401	1.4967
No log	3.6889	166	1.6279	0.1270	1.6279	1.2759
No log	3.7333	168	0.7538	0.1239	0.7538	0.8682
No log	3.7778	170	0.5371	0.0	0.5371	0.7329
No log	3.8222	172	0.5903	0.0	0.5903	0.7683
No log	3.8667	174	0.5168	0.0	0.5168	0.7189
No log	3.9111	176	0.5021	0.2326	0.5021	0.7086
No log	3.9556	178	0.5547	0.5769	0.5547	0.7448
No log	4.0	180	0.7069	0.3356	0.7069	0.8407
No log	4.0444	182	0.6775	0.3356	0.6775	0.8231
No log	4.0889	184	0.4583	0.1895	0.4583	0.6769
No log	4.1333	186	0.4057	0.0	0.4057	0.6370
No log	4.1778	188	0.4174	0.0	0.4174	0.6461
No log	4.2222	190	0.3933	0.2326	0.3933	0.6272
No log	4.2667	192	0.3921	0.2326	0.3921	0.6261
No log	4.3111	194	0.3986	0.2326	0.3986	0.6313
No log	4.3556	196	0.4503	0.2326	0.4503	0.6711
No log	4.4	198	0.4195	0.2326	0.4195	0.6477
No log	4.4444	200	0.4192	0.2326	0.4192	0.6475
No log	4.4889	202	0.4849	0.1895	0.4849	0.6963
No log	4.5333	204	0.4655	0.1895	0.4655	0.6823
No log	4.5778	206	0.4251	0.2326	0.4251	0.6520
No log	4.6222	208	0.4385	0.4444	0.4385	0.6622
No log	4.6667	210	0.4499	0.2326	0.4499	0.6707
No log	4.7111	212	0.4668	0.2326	0.4668	0.6832
No log	4.7556	214	0.4700	0.4444	0.4700	0.6856
No log	4.8	216	0.5288	0.384	0.5288	0.7272
No log	4.8444	218	0.5146	0.384	0.5146	0.7173
No log	4.8889	220	0.4940	0.2326	0.4940	0.7028
No log	4.9333	222	0.4825	0.2326	0.4825	0.6947
No log	4.9778	224	0.5687	0.1895	0.5687	0.7542
No log	5.0222	226	0.5118	0.1895	0.5118	0.7154
No log	5.0667	228	0.4982	0.1895	0.4982	0.7058
No log	5.1111	230	0.6042	0.1895	0.6042	0.7773
No log	5.1556	232	0.5529	0.1895	0.5529	0.7436
No log	5.2	234	0.4827	0.2326	0.4827	0.6947
No log	5.2444	236	0.4994	0.2326	0.4994	0.7067
No log	5.2889	238	0.4815	0.2326	0.4815	0.6939
No log	5.3333	240	0.5374	0.1895	0.5374	0.7331
No log	5.3778	242	0.8677	-0.0820	0.8677	0.9315
No log	5.4222	244	0.8111	-0.0820	0.8111	0.9006
No log	5.4667	246	0.5044	0.2326	0.5044	0.7102
No log	5.5111	248	0.5260	0.6071	0.5260	0.7253
No log	5.5556	250	0.5294	0.6071	0.5294	0.7276
No log	5.6	252	0.4698	0.2326	0.4698	0.6854
No log	5.6444	254	0.4774	0.2326	0.4774	0.6910
No log	5.6889	256	0.4491	0.2326	0.4491	0.6702
No log	5.7333	258	0.4336	0.2326	0.4336	0.6585
No log	5.7778	260	0.4449	0.2326	0.4449	0.6670
No log	5.8222	262	0.4326	0.2326	0.4326	0.6578
No log	5.8667	264	0.4475	0.2326	0.4475	0.6690
No log	5.9111	266	0.3961	0.2326	0.3961	0.6294
No log	5.9556	268	0.3945	0.2326	0.3945	0.6281
No log	6.0	270	0.4121	0.2326	0.4121	0.6420
No log	6.0444	272	0.3940	0.2326	0.3940	0.6277
No log	6.0889	274	0.4200	0.6071	0.4200	0.6481
No log	6.1333	276	0.4324	0.6071	0.4324	0.6576
No log	6.1778	278	0.4030	0.2326	0.4030	0.6348
No log	6.2222	280	0.4469	0.1895	0.4469	0.6685
No log	6.2667	282	0.5326	0.1895	0.5326	0.7298
No log	6.3111	284	0.5366	0.1895	0.5366	0.7325
No log	6.3556	286	0.4220	0.2326	0.4220	0.6496
No log	6.4	288	0.4179	0.2326	0.4179	0.6465
No log	6.4444	290	0.4462	0.2326	0.4462	0.6679
No log	6.4889	292	0.5280	0.1895	0.5280	0.7266
No log	6.5333	294	0.7356	0.1239	0.7356	0.8577
No log	6.5778	296	0.7564	0.1239	0.7564	0.8697
No log	6.6222	298	0.6057	0.1538	0.6057	0.7783
No log	6.6667	300	0.4498	0.2326	0.4498	0.6707
No log	6.7111	302	0.5187	0.4107	0.5187	0.7202
No log	6.7556	304	0.5946	0.4031	0.5946	0.7711
No log	6.8	306	0.5486	0.56	0.5486	0.7406
No log	6.8444	308	0.5045	0.2326	0.5045	0.7103
No log	6.8889	310	1.1266	0.0654	1.1266	1.0614
No log	6.9333	312	1.6800	0.0086	1.6800	1.2962
No log	6.9778	314	1.6217	0.0086	1.6217	1.2734
No log	7.0222	316	1.0992	0.0654	1.0992	1.0484
No log	7.0667	318	0.5671	0.1895	0.5671	0.7531
No log	7.1111	320	0.4779	0.2326	0.4779	0.6913
No log	7.1556	322	0.4774	0.2326	0.4774	0.6909
No log	7.2	324	0.4809	0.2326	0.4809	0.6934
No log	7.2444	326	0.5332	0.1895	0.5332	0.7302
No log	7.2889	328	0.5915	0.1895	0.5915	0.7691
No log	7.3333	330	0.5345	0.1895	0.5345	0.7311
No log	7.3778	332	0.4808	0.2326	0.4808	0.6934
No log	7.4222	334	0.4642	0.4444	0.4642	0.6813
No log	7.4667	336	0.4611	0.2326	0.4611	0.6791
No log	7.5111	338	0.4649	0.2326	0.4649	0.6819
No log	7.5556	340	0.4835	0.2326	0.4835	0.6954
No log	7.6	342	0.4830	0.2326	0.4830	0.6950
No log	7.6444	344	0.4858	0.1895	0.4858	0.6970
No log	7.6889	346	0.4846	0.1895	0.4846	0.6961
No log	7.7333	348	0.4655	0.1895	0.4655	0.6823
No log	7.7778	350	0.4594	0.1895	0.4594	0.6778
No log	7.8222	352	0.4477	0.4444	0.4477	0.6691
No log	7.8667	354	0.4642	0.4444	0.4642	0.6813
No log	7.9111	356	0.4699	0.4444	0.4699	0.6855
No log	7.9556	358	0.4516	0.4444	0.4516	0.6720
No log	8.0	360	0.4655	0.1895	0.4655	0.6822
No log	8.0444	362	0.5125	0.1895	0.5125	0.7159
No log	8.0889	364	0.5094	0.1895	0.5094	0.7137
No log	8.1333	366	0.4799	0.1895	0.4799	0.6927
No log	8.1778	368	0.4477	0.2326	0.4477	0.6691
No log	8.2222	370	0.4453	0.4444	0.4453	0.6673
No log	8.2667	372	0.4484	0.4444	0.4484	0.6697
No log	8.3111	374	0.4452	0.4444	0.4452	0.6672
No log	8.3556	376	0.4486	0.2326	0.4486	0.6698
No log	8.4	378	0.4676	0.1895	0.4676	0.6838
No log	8.4444	380	0.4863	0.1895	0.4863	0.6973
No log	8.4889	382	0.4871	0.1895	0.4871	0.6979
No log	8.5333	384	0.4781	0.1895	0.4781	0.6914
No log	8.5778	386	0.4651	0.1895	0.4651	0.6819
No log	8.6222	388	0.4560	0.1895	0.4560	0.6752
No log	8.6667	390	0.4420	0.2326	0.4420	0.6648
No log	8.7111	392	0.4281	0.4444	0.4281	0.6543
No log	8.7556	394	0.4239	0.4444	0.4239	0.6511
No log	8.8	396	0.4223	0.4444	0.4223	0.6498
No log	8.8444	398	0.4217	0.4444	0.4217	0.6494
No log	8.8889	400	0.4202	0.4444	0.4202	0.6482
No log	8.9333	402	0.4238	0.2326	0.4238	0.6510
No log	8.9778	404	0.4361	0.2326	0.4361	0.6604
No log	9.0222	406	0.4359	0.2326	0.4359	0.6602
No log	9.0667	408	0.4221	0.2326	0.4221	0.6497
No log	9.1111	410	0.4134	0.4444	0.4134	0.6430
No log	9.1556	412	0.4117	0.4444	0.4117	0.6417
No log	9.2	414	0.4122	0.4444	0.4122	0.6421
No log	9.2444	416	0.4119	0.4444	0.4119	0.6418
No log	9.2889	418	0.4113	0.4444	0.4113	0.6413
No log	9.3333	420	0.4129	0.4444	0.4129	0.6426
No log	9.3778	422	0.4189	0.2326	0.4189	0.6472
No log	9.4222	424	0.4266	0.2326	0.4266	0.6532
No log	9.4667	426	0.4348	0.2326	0.4348	0.6594
No log	9.5111	428	0.4345	0.2326	0.4345	0.6592
No log	9.5556	430	0.4289	0.2326	0.4289	0.6549
No log	9.6	432	0.4208	0.2326	0.4208	0.6487
No log	9.6444	434	0.4178	0.2326	0.4178	0.6464
No log	9.6889	436	0.4169	0.4444	0.4169	0.6457
No log	9.7333	438	0.4175	0.4444	0.4175	0.6461
No log	9.7778	440	0.4186	0.4444	0.4186	0.6470
No log	9.8222	442	0.4194	0.4444	0.4194	0.6476
No log	9.8667	444	0.4200	0.4444	0.4200	0.6481
No log	9.9111	446	0.4203	0.4444	0.4203	0.6483
No log	9.9556	448	0.4206	0.4444	0.4206	0.6486
No log	10.0	450	0.4207	0.4444	0.4207	0.6486

Framework versions

—Transformers 4.44.2
—Pytorch 2.4.0+cu118
—Datasets 2.21.0
—Tokenizers 0.19.1