Modelpublic

MayBashendy/ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run2_AugV5_k11_task2_organization

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes13downloads

Model Card

ArabicNewSplits7usingALLEssaysFineTuningAraBERTrun2AugV5k11task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

—Loss: 1.0648
—Qwk: 0.2424
—Mse: 1.0648
—Rmse: 1.0319

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 2e-05
—trainbatchsize: 8
—evalbatchsize: 8
—seed: 42
—optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
—lrschedulertype: linear
—num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0513	2	4.4530	-0.0191	4.4530	2.1102
No log	0.1026	4	2.6052	0.0141	2.6052	1.6141
No log	0.1538	6	2.9782	-0.1052	2.9782	1.7258
No log	0.2051	8	3.0674	-0.1182	3.0674	1.7514
No log	0.2564	10	1.9982	-0.0017	1.9982	1.4136
No log	0.3077	12	1.8491	-0.0017	1.8491	1.3598
No log	0.3590	14	1.8580	0.0372	1.8580	1.3631
No log	0.4103	16	1.6887	0.0372	1.6887	1.2995
No log	0.4615	18	1.5986	0.0372	1.5986	1.2644
No log	0.5128	20	1.5593	0.0372	1.5593	1.2487
No log	0.5641	22	1.3758	0.1838	1.3758	1.1729
No log	0.6154	24	1.2593	0.1262	1.2593	1.1222
No log	0.6667	26	1.5558	0.1141	1.5558	1.2473
No log	0.7179	28	2.7991	-0.0325	2.7991	1.6731
No log	0.7692	30	3.2963	-0.0310	3.2963	1.8156
No log	0.8205	32	2.4233	0.0215	2.4233	1.5567
No log	0.8718	34	1.4623	0.1021	1.4623	1.2093
No log	0.9231	36	1.2351	0.1556	1.2351	1.1113
No log	0.9744	38	1.2159	0.1732	1.2159	1.1027
No log	1.0256	40	1.2198	0.1271	1.2198	1.1044
No log	1.0769	42	1.3326	0.1711	1.3326	1.1544
No log	1.1282	44	1.6220	0.1109	1.6220	1.2736
No log	1.1795	46	1.6213	0.1109	1.6213	1.2733
No log	1.2308	48	1.4906	0.1460	1.4906	1.2209
No log	1.2821	50	1.3852	0.1858	1.3852	1.1770
No log	1.3333	52	1.3537	0.1619	1.3537	1.1635
No log	1.3846	54	1.3418	0.2388	1.3418	1.1584
No log	1.4359	56	1.2888	0.1655	1.2888	1.1352
No log	1.4872	58	1.2838	0.1852	1.2838	1.1331
No log	1.5385	60	1.4337	0.2690	1.4337	1.1974
No log	1.5897	62	1.3877	0.3340	1.3877	1.1780
No log	1.6410	64	1.2077	0.2391	1.2077	1.0989
No log	1.6923	66	1.1165	0.2814	1.1165	1.0566
No log	1.7436	68	1.1041	0.2918	1.1041	1.0508
No log	1.7949	70	1.2030	0.2881	1.2030	1.0968
No log	1.8462	72	1.1640	0.2760	1.1640	1.0789
No log	1.8974	74	1.1185	0.2777	1.1185	1.0576
No log	1.9487	76	1.1475	0.2891	1.1475	1.0712
No log	2.0	78	1.2467	0.2457	1.2467	1.1165
No log	2.0513	80	1.2324	0.2062	1.2324	1.1101
No log	2.1026	82	1.2166	0.1743	1.2166	1.1030
No log	2.1538	84	1.2454	0.1979	1.2454	1.1160
No log	2.2051	86	1.1585	0.2734	1.1585	1.0763
No log	2.2564	88	1.0672	0.3056	1.0672	1.0330
No log	2.3077	90	1.1819	0.3330	1.1819	1.0872
No log	2.3590	92	1.2535	0.3595	1.2535	1.1196
No log	2.4103	94	1.3331	0.3042	1.3331	1.1546
No log	2.4615	96	1.4754	0.2430	1.4754	1.2146
No log	2.5128	98	1.4603	0.2717	1.4603	1.2084
No log	2.5641	100	1.3016	0.3192	1.3016	1.1409
No log	2.6154	102	1.0860	0.2991	1.0860	1.0421
No log	2.6667	104	1.1586	0.3165	1.1586	1.0764
No log	2.7179	106	1.1175	0.3455	1.1175	1.0571
No log	2.7692	108	1.0915	0.2654	1.0915	1.0447
No log	2.8205	110	1.3555	0.1891	1.3555	1.1642
No log	2.8718	112	1.3795	0.1848	1.3795	1.1745
No log	2.9231	114	1.1931	0.2984	1.1931	1.0923
No log	2.9744	116	1.1215	0.2622	1.1215	1.0590
No log	3.0256	118	1.1428	0.2732	1.1428	1.0690
No log	3.0769	120	1.2264	0.2895	1.2264	1.1074
No log	3.1282	122	1.2205	0.2919	1.2205	1.1047
No log	3.1795	124	1.1297	0.2877	1.1297	1.0629
No log	3.2308	126	1.1476	0.3846	1.1476	1.0713
No log	3.2821	128	1.1103	0.3870	1.1103	1.0537
No log	3.3333	130	1.0989	0.3262	1.0989	1.0483
No log	3.3846	132	1.1575	0.2806	1.1575	1.0759
No log	3.4359	134	1.1042	0.2685	1.1042	1.0508
No log	3.4872	136	1.0694	0.2871	1.0694	1.0341
No log	3.5385	138	1.1003	0.2993	1.1003	1.0490
No log	3.5897	140	1.1221	0.2712	1.1221	1.0593
No log	3.6410	142	1.4418	0.2292	1.4418	1.2008
No log	3.6923	144	1.5965	0.2489	1.5965	1.2635
No log	3.7436	146	1.3691	0.3050	1.3691	1.1701
No log	3.7949	148	1.2720	0.3254	1.2720	1.1278
No log	3.8462	150	1.2930	0.3175	1.2930	1.1371
No log	3.8974	152	1.1884	0.3036	1.1884	1.0901
No log	3.9487	154	1.2426	0.3404	1.2426	1.1147
No log	4.0	156	1.3072	0.2574	1.3072	1.1433
No log	4.0513	158	1.1592	0.3665	1.1592	1.0767
No log	4.1026	160	1.0503	0.3648	1.0503	1.0248
No log	4.1538	162	1.0472	0.3458	1.0472	1.0233
No log	4.2051	164	1.0568	0.3059	1.0568	1.0280
No log	4.2564	166	1.0767	0.2730	1.0767	1.0376
No log	4.3077	168	1.0601	0.2730	1.0601	1.0296
No log	4.3590	170	1.0310	0.4159	1.0310	1.0154
No log	4.4103	172	1.0568	0.3724	1.0568	1.0280
No log	4.4615	174	1.0875	0.3811	1.0875	1.0429
No log	4.5128	176	1.1750	0.3753	1.1750	1.0840
No log	4.5641	178	1.2254	0.3994	1.2254	1.1070
No log	4.6154	180	1.1661	0.3374	1.1661	1.0799
No log	4.6667	182	1.2196	0.3165	1.2196	1.1044
No log	4.7179	184	1.1431	0.3061	1.1431	1.0692
No log	4.7692	186	1.0443	0.4160	1.0443	1.0219
No log	4.8205	188	1.0927	0.3595	1.0927	1.0453
No log	4.8718	190	1.2537	0.3275	1.2537	1.1197
No log	4.9231	192	1.3027	0.2353	1.3027	1.1413
No log	4.9744	194	1.1689	0.3601	1.1689	1.0812
No log	5.0256	196	1.0648	0.3010	1.0648	1.0319
No log	5.0769	198	1.0854	0.3655	1.0854	1.0418
No log	5.1282	200	1.0820	0.3193	1.0820	1.0402
No log	5.1795	202	1.0663	0.3490	1.0663	1.0326
No log	5.2308	204	1.0549	0.3881	1.0549	1.0271
No log	5.2821	206	1.0543	0.3555	1.0543	1.0268
No log	5.3333	208	1.0514	0.3463	1.0514	1.0254
No log	5.3846	210	1.0245	0.4708	1.0245	1.0122
No log	5.4359	212	1.1716	0.3765	1.1716	1.0824
No log	5.4872	214	1.5543	0.1929	1.5543	1.2467
No log	5.5385	216	1.5992	0.1815	1.5992	1.2646
No log	5.5897	218	1.3037	0.3002	1.3037	1.1418
No log	5.6410	220	1.0894	0.3950	1.0894	1.0437
No log	5.6923	222	1.2366	0.2568	1.2366	1.1120
No log	5.7436	224	1.2416	0.2885	1.2416	1.1143
No log	5.7949	226	1.0825	0.3262	1.0825	1.0404
No log	5.8462	228	1.0582	0.3430	1.0582	1.0287
No log	5.8974	230	1.1035	0.2838	1.1035	1.0505
No log	5.9487	232	1.0914	0.3172	1.0914	1.0447
No log	6.0	234	1.0604	0.2995	1.0604	1.0297
No log	6.0513	236	1.0607	0.3607	1.0607	1.0299
No log	6.1026	238	1.1025	0.3052	1.1025	1.0500
No log	6.1538	240	1.0591	0.2699	1.0591	1.0291
No log	6.2051	242	1.0021	0.3399	1.0021	1.0010
No log	6.2564	244	1.0260	0.3300	1.0260	1.0129
No log	6.3077	246	1.0195	0.3565	1.0195	1.0097
No log	6.3590	248	1.0193	0.2012	1.0193	1.0096
No log	6.4103	250	1.1734	0.3348	1.1734	1.0833
No log	6.4615	252	1.4523	0.2981	1.4523	1.2051
No log	6.5128	254	1.5151	0.2778	1.5151	1.2309
No log	6.5641	256	1.2829	0.2961	1.2829	1.1326
No log	6.6154	258	1.0671	0.3329	1.0671	1.0330
No log	6.6667	260	1.1112	0.2955	1.1112	1.0541
No log	6.7179	262	1.1124	0.3187	1.1124	1.0547
No log	6.7692	264	1.0487	0.3059	1.0487	1.0241
No log	6.8205	266	1.1732	0.3395	1.1732	1.0832
No log	6.8718	268	1.5765	0.3121	1.5765	1.2556
No log	6.9231	270	1.7210	0.2628	1.7210	1.3119
No log	6.9744	272	1.5053	0.3191	1.5053	1.2269
No log	7.0256	274	1.1814	0.3307	1.1814	1.0869
No log	7.0769	276	1.0341	0.3194	1.0341	1.0169
No log	7.1282	278	1.0173	0.3486	1.0173	1.0086
No log	7.1795	280	0.9932	0.3014	0.9932	0.9966
No log	7.2308	282	1.0147	0.3665	1.0147	1.0073
No log	7.2821	284	1.0575	0.3624	1.0575	1.0283
No log	7.3333	286	1.1288	0.3267	1.1288	1.0624
No log	7.3846	288	1.0896	0.3521	1.0896	1.0439
No log	7.4359	290	1.0382	0.3846	1.0382	1.0189
No log	7.4872	292	1.0528	0.3418	1.0528	1.0261
No log	7.5385	294	1.0696	0.3505	1.0696	1.0342
No log	7.5897	296	1.1505	0.3280	1.1505	1.0726
No log	7.6410	298	1.2832	0.2961	1.2832	1.1328
No log	7.6923	300	1.2402	0.3202	1.2402	1.1136
No log	7.7436	302	1.0985	0.3519	1.0985	1.0481
No log	7.7949	304	1.0383	0.3537	1.0383	1.0189
No log	7.8462	306	1.0411	0.3537	1.0411	1.0204
No log	7.8974	308	1.0471	0.3205	1.0471	1.0233
No log	7.9487	310	1.0604	0.3205	1.0604	1.0298
No log	8.0	312	1.0658	0.3205	1.0658	1.0324
No log	8.0513	314	1.0597	0.2697	1.0597	1.0294
No log	8.1026	316	1.0687	0.3179	1.0687	1.0338
No log	8.1538	318	1.1059	0.2432	1.1059	1.0516
No log	8.2051	320	1.0982	0.2891	1.0982	1.0480
No log	8.2564	322	1.0621	0.2495	1.0621	1.0306
No log	8.3077	324	1.0727	0.2169	1.0727	1.0357
No log	8.3590	326	1.0718	0.2259	1.0718	1.0353
No log	8.4103	328	1.0983	0.2624	1.0983	1.0480
No log	8.4615	330	1.0725	0.2259	1.0725	1.0356
No log	8.5128	332	1.0303	0.3539	1.0303	1.0150
No log	8.5641	334	1.0385	0.3908	1.0385	1.0191
No log	8.6154	336	1.0330	0.3392	1.0330	1.0164
No log	8.6667	338	1.0423	0.3493	1.0423	1.0209
No log	8.7179	340	1.0329	0.3493	1.0329	1.0163
No log	8.7692	342	1.0467	0.3345	1.0467	1.0231
No log	8.8205	344	1.0489	0.3957	1.0489	1.0242
No log	8.8718	346	0.9967	0.3796	0.9967	0.9983
No log	8.9231	348	0.9724	0.4081	0.9724	0.9861
No log	8.9744	350	0.9663	0.3948	0.9663	0.9830
No log	9.0256	352	0.9677	0.4628	0.9677	0.9837
No log	9.0769	354	1.0103	0.4482	1.0103	1.0051
No log	9.1282	356	1.0061	0.4482	1.0061	1.0030
No log	9.1795	358	0.9786	0.4548	0.9786	0.9892
No log	9.2308	360	0.9997	0.3243	0.9997	0.9999
No log	9.2821	362	1.0167	0.3149	1.0167	1.0083
No log	9.3333	364	0.9958	0.2730	0.9958	0.9979
No log	9.3846	366	1.0284	0.4002	1.0284	1.0141
No log	9.4359	368	1.0690	0.3396	1.0690	1.0339
No log	9.4872	370	1.0442	0.3695	1.0442	1.0219
No log	9.5385	372	1.0630	0.2795	1.0630	1.0310
No log	9.5897	374	1.1207	0.3218	1.1207	1.0586
No log	9.6410	376	1.0987	0.2748	1.0987	1.0482
No log	9.6923	378	1.0544	0.2358	1.0544	1.0269
No log	9.7436	380	1.0571	0.2306	1.0571	1.0281
No log	9.7949	382	1.0726	0.2505	1.0726	1.0357
No log	9.8462	384	1.1339	0.2611	1.1339	1.0648
No log	9.8974	386	1.1079	0.2920	1.1079	1.0526
No log	9.9487	388	1.0548	0.2851	1.0548	1.0270
No log	10.0	390	1.0409	0.2505	1.0409	1.0202
No log	10.0513	392	1.0315	0.2555	1.0315	1.0156
No log	10.1026	394	1.0174	0.2697	1.0174	1.0087
No log	10.1538	396	1.0231	0.2764	1.0231	1.0115
No log	10.2051	398	1.0413	0.3157	1.0413	1.0204
No log	10.2564	400	1.0294	0.2766	1.0294	1.0146
No log	10.3077	402	1.0180	0.3014	1.0180	1.0090
No log	10.3590	404	1.0176	0.3137	1.0176	1.0088
No log	10.4103	406	1.0377	0.2966	1.0377	1.0187
No log	10.4615	408	1.0418	0.2682	1.0418	1.0207
No log	10.5128	410	1.0519	0.3415	1.0519	1.0256
No log	10.5641	412	1.1120	0.3275	1.1120	1.0545
No log	10.6154	414	1.1307	0.2654	1.1307	1.0633
No log	10.6667	416	1.0949	0.3729	1.0949	1.0464
No log	10.7179	418	1.0506	0.2629	1.0506	1.0250
No log	10.7692	420	1.0814	0.2637	1.0814	1.0399
No log	10.8205	422	1.1315	0.3415	1.1315	1.0637
No log	10.8718	424	1.0961	0.3736	1.0961	1.0469
No log	10.9231	426	1.0294	0.2697	1.0294	1.0146
No log	10.9744	428	1.0135	0.2550	1.0135	1.0067
No log	11.0256	430	1.0107	0.2697	1.0107	1.0053
No log	11.0769	432	1.0468	0.4023	1.0468	1.0231
No log	11.1282	434	1.0587	0.3972	1.0587	1.0289
No log	11.1795	436	1.0029	0.3059	1.0029	1.0014
No log	11.2308	438	1.0037	0.3663	1.0037	1.0018
No log	11.2821	440	1.0085	0.3762	1.0085	1.0043
No log	11.3333	442	0.9980	0.2871	0.9980	0.9990
No log	11.3846	444	1.0322	0.3981	1.0322	1.0160
No log	11.4359	446	1.0412	0.4076	1.0412	1.0204
No log	11.4872	448	1.0267	0.3059	1.0267	1.0133
No log	11.5385	450	1.0025	0.3250	1.0025	1.0012
No log	11.5897	452	0.9948	0.2966	0.9948	0.9974
No log	11.6410	454	0.9951	0.3458	0.9951	0.9976
No log	11.6923	456	0.9930	0.3554	0.9930	0.9965
No log	11.7436	458	0.9892	0.3346	0.9892	0.9946
No log	11.7949	460	1.0140	0.3476	1.0140	1.0070
No log	11.8462	462	1.0179	0.3476	1.0179	1.0089
No log	11.8974	464	1.0035	0.3199	1.0035	1.0018
No log	11.9487	466	0.9905	0.3390	0.9905	0.9952
No log	12.0	468	0.9986	0.3338	0.9986	0.9993
No log	12.0513	470	0.9937	0.3668	0.9937	0.9968
No log	12.1026	472	0.9947	0.3541	0.9947	0.9973
No log	12.1538	474	1.0086	0.3639	1.0086	1.0043
No log	12.2051	476	1.0221	0.3113	1.0221	1.0110
No log	12.2564	478	1.0421	0.3301	1.0421	1.0208
No log	12.3077	480	1.0649	0.3250	1.0649	1.0319
No log	12.3590	482	1.0962	0.3213	1.0962	1.0470
No log	12.4103	484	1.1378	0.3389	1.1378	1.0667
No log	12.4615	486	1.1327	0.3207	1.1327	1.0643
No log	12.5128	488	1.0557	0.3126	1.0557	1.0275
No log	12.5641	490	1.0215	0.4064	1.0215	1.0107
No log	12.6154	492	1.0083	0.3747	1.0083	1.0041
No log	12.6667	494	1.0176	0.3541	1.0176	1.0088
No log	12.7179	496	1.0525	0.3149	1.0525	1.0259
No log	12.7692	498	1.0905	0.2640	1.0905	1.0443
0.3255	12.8205	500	1.0472	0.3476	1.0472	1.0233
0.3255	12.8718	502	1.0011	0.4122	1.0011	1.0005
0.3255	12.9231	504	1.0037	0.3858	1.0037	1.0018
0.3255	12.9744	506	0.9981	0.4122	0.9981	0.9991
0.3255	13.0256	508	1.0670	0.3624	1.0670	1.0329
0.3255	13.0769	510	1.1473	0.2757	1.1473	1.0711
0.3255	13.1282	512	1.0831	0.3314	1.0831	1.0407
0.3255	13.1795	514	1.0449	0.3287	1.0449	1.0222
0.3255	13.2308	516	1.0230	0.3338	1.0230	1.0114
0.3255	13.2821	518	0.9940	0.3541	0.9940	0.9970
0.3255	13.3333	520	0.9841	0.3497	0.9841	0.9920
0.3255	13.3846	522	0.9745	0.3256	0.9745	0.9872
0.3255	13.4359	524	0.9864	0.3529	0.9864	0.9932
0.3255	13.4872	526	1.0044	0.3321	1.0044	1.0022
0.3255	13.5385	528	1.0023	0.3321	1.0023	1.0011
0.3255	13.5897	530	1.0013	0.2892	1.0013	1.0007
0.3255	13.6410	532	1.0021	0.3086	1.0021	1.0010
0.3255	13.6923	534	1.0070	0.3639	1.0070	1.0035
0.3255	13.7436	536	1.0198	0.3639	1.0198	1.0098
0.3255	13.7949	538	1.0453	0.3346	1.0453	1.0224
0.3255	13.8462	540	1.0909	0.3199	1.0909	1.0445
0.3255	13.8974	542	1.1346	0.2942	1.1346	1.0652
0.3255	13.9487	544	1.0902	0.3154	1.0902	1.0441
0.3255	14.0	546	1.0648	0.2424	1.0648	1.0319

Framework versions

—Transformers 4.44.2
—Pytorch 2.4.0+cu118
—Datasets 2.21.0
—Tokenizers 0.19.1