Modelpublic

MayBashendy/Arabic_FineTuningAraBERT_AugV4_k3_task2_organization_fold0

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes8downloads

Model Card

ArabicFineTuningAraBERTAugV4k3task2organizationfold0

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

—Loss: 0.5409
—Qwk: 0.5473
—Mse: 0.5409
—Rmse: 0.7355

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 2e-05
—trainbatchsize: 8
—evalbatchsize: 8
—seed: 42
—optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
—lrschedulertype: linear
—num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0465	2	3.3070	0.0	3.3070	1.8185
No log	0.0930	4	2.1837	0.0172	2.1837	1.4777
No log	0.1395	6	0.9294	0.0	0.9294	0.9640
No log	0.1860	8	0.7024	0.1560	0.7024	0.8381
No log	0.2326	10	0.7799	0.0679	0.7799	0.8831
No log	0.2791	12	0.9845	0.0	0.9845	0.9922
No log	0.3256	14	1.0949	0.1637	1.0949	1.0464
No log	0.3721	16	1.1012	0.1398	1.1012	1.0494
No log	0.4186	18	1.0338	0.0	1.0338	1.0168
No log	0.4651	20	0.8928	0.0	0.8928	0.9449
No log	0.5116	22	0.8613	0.0	0.8613	0.9281
No log	0.5581	24	0.7567	0.0	0.7567	0.8699
No log	0.6047	26	0.7885	0.0	0.7885	0.8880
No log	0.6512	28	0.8915	0.0	0.8915	0.9442
No log	0.6977	30	0.9626	0.0	0.9626	0.9811
No log	0.7442	32	0.9361	0.0	0.9361	0.9675
No log	0.7907	34	0.8462	0.0	0.8462	0.9199
No log	0.8372	36	0.7091	0.0	0.7091	0.8421
No log	0.8837	38	0.6543	0.0	0.6543	0.8089
No log	0.9302	40	0.6321	0.0	0.6321	0.7950
No log	0.9767	42	0.6734	0.0	0.6734	0.8206
No log	1.0233	44	0.7440	0.0	0.7440	0.8626
No log	1.0698	46	0.7728	0.0	0.7728	0.8791
No log	1.1163	48	0.7581	0.0	0.7581	0.8707
No log	1.1628	50	0.6606	0.0679	0.6606	0.8128
No log	1.2093	52	0.5970	0.1340	0.5970	0.7727
No log	1.2558	54	0.5793	0.1985	0.5793	0.7611
No log	1.3023	56	0.5874	0.1985	0.5874	0.7664
No log	1.3488	58	0.6034	0.1985	0.6034	0.7768
No log	1.3953	60	0.6204	0.0916	0.6204	0.7876
No log	1.4419	62	0.7750	0.3277	0.7750	0.8803
No log	1.4884	64	0.8067	0.3198	0.8067	0.8982
No log	1.5349	66	0.6054	0.0679	0.6054	0.7781
No log	1.5814	68	0.5665	0.1340	0.5665	0.7526
No log	1.6279	70	0.5599	0.1340	0.5599	0.7483
No log	1.6744	72	0.6716	0.3198	0.6716	0.8195
No log	1.7209	74	0.8824	0.3345	0.8824	0.9394
No log	1.7674	76	0.9000	0.3405	0.9000	0.9487
No log	1.8140	78	0.7094	0.3198	0.7094	0.8423
No log	1.8605	80	0.6438	0.3636	0.6438	0.8024
No log	1.9070	82	0.4836	0.4923	0.4836	0.6954
No log	1.9535	84	0.4661	0.5032	0.4661	0.6827
No log	2.0	86	0.4832	0.5257	0.4832	0.6951
No log	2.0465	88	0.7103	0.3770	0.7103	0.8428
No log	2.0930	90	0.8502	0.2486	0.8502	0.9221
No log	2.1395	92	0.8236	0.2486	0.8236	0.9075
No log	2.1860	94	0.7468	0.3345	0.7468	0.8642
No log	2.2326	96	0.5612	0.4177	0.5612	0.7491
No log	2.2791	98	0.4336	0.5732	0.4336	0.6585
No log	2.3256	100	0.4305	0.4112	0.4305	0.6561
No log	2.3721	102	0.4294	0.4665	0.4294	0.6553
No log	2.4186	104	0.4214	0.5257	0.4214	0.6491
No log	2.4651	106	0.5251	0.4167	0.5251	0.7247
No log	2.5116	108	0.6514	0.3770	0.6514	0.8071
No log	2.5581	110	0.6233	0.3770	0.6233	0.7895
No log	2.6047	112	0.5120	0.3521	0.5120	0.7155
No log	2.6512	114	0.4681	0.3201	0.4681	0.6842
No log	2.6977	116	0.4788	0.3521	0.4788	0.6919
No log	2.7442	118	0.5047	0.3521	0.5047	0.7104
No log	2.7907	120	0.6049	0.4187	0.6049	0.7777
No log	2.8372	122	0.5966	0.4187	0.5966	0.7724
No log	2.8837	124	0.6507	0.4492	0.6507	0.8066
No log	2.9302	126	0.5966	0.3877	0.5966	0.7724
No log	2.9767	128	0.5116	0.3571	0.5116	0.7153
No log	3.0233	130	0.5378	0.3877	0.5378	0.7334
No log	3.0698	132	0.6042	0.3877	0.6042	0.7773
No log	3.1163	134	0.5416	0.3521	0.5416	0.7359
No log	3.1628	136	0.4995	0.3201	0.4995	0.7068
No log	3.2093	138	0.4912	0.3588	0.4912	0.7009
No log	3.2558	140	0.5107	0.3636	0.5107	0.7146
No log	3.3023	142	0.5189	0.3636	0.5189	0.7204
No log	3.3488	144	0.5571	0.3679	0.5571	0.7464
No log	3.3953	146	0.5548	0.4080	0.5548	0.7449
No log	3.4419	148	0.5697	0.4185	0.5697	0.7548
No log	3.4884	150	0.5736	0.4632	0.5736	0.7574
No log	3.5349	152	0.5834	0.4273	0.5834	0.7638
No log	3.5814	154	0.6010	0.3908	0.6010	0.7752
No log	3.6279	156	0.6354	0.3783	0.6354	0.7971
No log	3.6744	158	0.6916	0.4648	0.6916	0.8316
No log	3.7209	160	0.6359	0.4381	0.6359	0.7974
No log	3.7674	162	0.6073	0.3783	0.6073	0.7793
No log	3.8140	164	0.6029	0.3783	0.6029	0.7765
No log	3.8605	166	0.5657	0.4861	0.5657	0.7521
No log	3.9070	168	0.5526	0.4861	0.5526	0.7433
No log	3.9535	170	0.5837	0.3783	0.5837	0.7640
No log	4.0	172	0.6044	0.4378	0.6044	0.7774
No log	4.0465	174	0.6032	0.4	0.6032	0.7766
No log	4.0930	176	0.5460	0.5164	0.5460	0.7389
No log	4.1395	178	0.5176	0.5191	0.5176	0.7195
No log	4.1860	180	0.4956	0.5263	0.4956	0.7040
No log	4.2326	182	0.4842	0.6294	0.4842	0.6958
No log	4.2791	184	0.4907	0.5263	0.4907	0.7005
No log	4.3256	186	0.5083	0.4474	0.5083	0.7129
No log	4.3721	188	0.5120	0.4474	0.5120	0.7156
No log	4.4186	190	0.5020	0.4474	0.5020	0.7085
No log	4.4651	192	0.5256	0.5084	0.5256	0.7250
No log	4.5116	194	0.5905	0.4288	0.5905	0.7684
No log	4.5581	196	0.6228	0.4288	0.6228	0.7892
No log	4.6047	198	0.6122	0.4288	0.6122	0.7824
No log	4.6512	200	0.5183	0.6917	0.5183	0.7199
No log	4.6977	202	0.4881	0.6294	0.4881	0.6986
No log	4.7442	204	0.4862	0.6294	0.4862	0.6973
No log	4.7907	206	0.5029	0.6818	0.5029	0.7092
No log	4.8372	208	0.5990	0.5625	0.5990	0.7740
No log	4.8837	210	0.7365	0.4290	0.7365	0.8582
No log	4.9302	212	0.7575	0.4290	0.7575	0.8704
No log	4.9767	214	0.6383	0.4288	0.6383	0.7989
No log	5.0233	216	0.5005	0.7070	0.5005	0.7074
No log	5.0698	218	0.4464	0.5987	0.4464	0.6681
No log	5.1163	220	0.4471	0.6351	0.4471	0.6687
No log	5.1628	222	0.4525	0.6024	0.4525	0.6727
No log	5.2093	224	0.5007	0.6546	0.5007	0.7076
No log	5.2558	226	0.6106	0.4288	0.6106	0.7814
No log	5.3023	228	0.6904	0.4290	0.6904	0.8309
No log	5.3488	230	0.6351	0.4288	0.6351	0.7969
No log	5.3953	232	0.5683	0.4288	0.5683	0.7539
No log	5.4419	234	0.4957	0.5548	0.4957	0.7040
No log	5.4884	236	0.4736	0.6690	0.4736	0.6882
No log	5.5349	238	0.4787	0.5548	0.4787	0.6919
No log	5.5814	240	0.5258	0.5786	0.5258	0.7251
No log	5.6279	242	0.5301	0.5786	0.5301	0.7281
No log	5.6744	244	0.4978	0.5134	0.4978	0.7056
No log	5.7209	246	0.4881	0.4806	0.4881	0.6986
No log	5.7674	248	0.5321	0.5786	0.5321	0.7295
No log	5.8140	250	0.5387	0.5396	0.5387	0.7339
No log	5.8605	252	0.4961	0.5219	0.4961	0.7043
No log	5.9070	254	0.4674	0.6354	0.4674	0.6837
No log	5.9535	256	0.4700	0.6354	0.4700	0.6856
No log	6.0	258	0.5012	0.5855	0.5012	0.7079
No log	6.0465	260	0.5454	0.5396	0.5454	0.7385
No log	6.0930	262	0.5816	0.4288	0.5816	0.7627
No log	6.1395	264	0.6330	0.4288	0.6330	0.7956
No log	6.1860	266	0.6287	0.4288	0.6287	0.7929
No log	6.2326	268	0.5624	0.4288	0.5624	0.7499
No log	6.2791	270	0.5018	0.3980	0.5018	0.7084
No log	6.3256	272	0.4705	0.4483	0.4705	0.6859
No log	6.3721	274	0.4698	0.4896	0.4698	0.6854
No log	6.4186	276	0.4561	0.6140	0.4561	0.6754
No log	6.4651	278	0.4527	0.6024	0.4527	0.6729
No log	6.5116	280	0.4544	0.6024	0.4544	0.6741
No log	6.5581	282	0.4597	0.5922	0.4597	0.6780
No log	6.6047	284	0.4736	0.5922	0.4736	0.6882
No log	6.6512	286	0.4926	0.6232	0.4926	0.7019
No log	6.6977	288	0.5239	0.6062	0.5239	0.7238
No log	6.7442	290	0.5465	0.6062	0.5465	0.7393
No log	6.7907	292	0.5529	0.6062	0.5529	0.7436
No log	6.8372	294	0.5523	0.6062	0.5523	0.7432
No log	6.8837	296	0.5221	0.5164	0.5221	0.7226
No log	6.9302	298	0.5062	0.6024	0.5062	0.7115
No log	6.9767	300	0.5026	0.5987	0.5026	0.7089
No log	7.0233	302	0.5200	0.5164	0.5200	0.7211
No log	7.0698	304	0.5713	0.4667	0.5713	0.7559
No log	7.1163	306	0.6850	0.4290	0.6850	0.8276
No log	7.1628	308	0.7610	0.4566	0.7610	0.8724
No log	7.2093	310	0.7699	0.4566	0.7699	0.8775
No log	7.2558	312	0.7133	0.4290	0.7133	0.8446
No log	7.3023	314	0.6152	0.4288	0.6152	0.7843
No log	7.3488	316	0.5222	0.5164	0.5222	0.7226
No log	7.3953	318	0.4880	0.6024	0.4880	0.6986
No log	7.4419	320	0.4821	0.6024	0.4821	0.6943
No log	7.4884	322	0.4868	0.6232	0.4868	0.6977
No log	7.5349	324	0.5009	0.5164	0.5009	0.7077
No log	7.5814	326	0.5041	0.5164	0.5041	0.7100
No log	7.6279	328	0.5109	0.5164	0.5109	0.7147
No log	7.6744	330	0.5206	0.5473	0.5206	0.7216
No log	7.7209	332	0.5522	0.5701	0.5522	0.7431
No log	7.7674	334	0.5822	0.4288	0.5822	0.7630
No log	7.8140	336	0.5744	0.4667	0.5744	0.7579
No log	7.8605	338	0.5526	0.5701	0.5526	0.7433
No log	7.9070	340	0.5349	0.5084	0.5349	0.7314
No log	7.9535	342	0.5244	0.5473	0.5244	0.7241
No log	8.0	344	0.5050	0.5164	0.5050	0.7106
No log	8.0465	346	0.4914	0.4861	0.4914	0.7010
No log	8.0930	348	0.4905	0.4861	0.4905	0.7003
No log	8.1395	350	0.4988	0.5164	0.4988	0.7063
No log	8.1860	352	0.5060	0.5473	0.5060	0.7113
No log	8.2326	354	0.5251	0.5084	0.5251	0.7247
No log	8.2791	356	0.5576	0.5701	0.5576	0.7467
No log	8.3256	358	0.5732	0.4667	0.5732	0.7571
No log	8.3721	360	0.5855	0.5333	0.5855	0.7652
No log	8.4186	362	0.5755	0.5333	0.5755	0.7586
No log	8.4651	364	0.5472	0.6062	0.5472	0.7398
No log	8.5116	366	0.5289	0.5473	0.5289	0.7273
No log	8.5581	368	0.5073	0.5164	0.5073	0.7123
No log	8.6047	370	0.4982	0.5164	0.4982	0.7059
No log	8.6512	372	0.4994	0.5164	0.4994	0.7067
No log	8.6977	374	0.5038	0.5164	0.5038	0.7098
No log	8.7442	376	0.5142	0.5164	0.5142	0.7171
No log	8.7907	378	0.5163	0.5164	0.5163	0.7185
No log	8.8372	380	0.5145	0.5164	0.5145	0.7173
No log	8.8837	382	0.5203	0.5164	0.5203	0.7213
No log	8.9302	384	0.5319	0.5473	0.5319	0.7293
No log	8.9767	386	0.5455	0.5473	0.5455	0.7386
No log	9.0233	388	0.5459	0.5473	0.5459	0.7389
No log	9.0698	390	0.5386	0.5473	0.5386	0.7339
No log	9.1163	392	0.5302	0.5164	0.5302	0.7281
No log	9.1628	394	0.5251	0.5164	0.5251	0.7246
No log	9.2093	396	0.5236	0.5164	0.5236	0.7236
No log	9.2558	398	0.5246	0.5164	0.5246	0.7243
No log	9.3023	400	0.5222	0.5164	0.5222	0.7226
No log	9.3488	402	0.5154	0.5164	0.5154	0.7179
No log	9.3953	404	0.5136	0.5164	0.5136	0.7166
No log	9.4419	406	0.5150	0.5164	0.5150	0.7177
No log	9.4884	408	0.5183	0.5164	0.5183	0.7199
No log	9.5349	410	0.5233	0.5164	0.5233	0.7234
No log	9.5814	412	0.5255	0.5164	0.5255	0.7249
No log	9.6279	414	0.5296	0.5164	0.5296	0.7277
No log	9.6744	416	0.5324	0.5473	0.5324	0.7297
No log	9.7209	418	0.5340	0.5473	0.5340	0.7308
No log	9.7674	420	0.5359	0.5473	0.5359	0.7321
No log	9.8140	422	0.5371	0.5473	0.5371	0.7329
No log	9.8605	424	0.5380	0.5473	0.5380	0.7335
No log	9.9070	426	0.5395	0.5473	0.5395	0.7345
No log	9.9535	428	0.5404	0.5473	0.5404	0.7351
No log	10.0	430	0.5409	0.5473	0.5409	0.7355

Framework versions

—Transformers 4.44.2
—Pytorch 2.4.0+cu118
—Datasets 2.21.0
—Tokenizers 0.19.1