Modelpublic

phunganhsang/Revision_Pho_Lexical_46kClsXlm

sourceHugging Faceagpl-3.0updated 7mo agoView on Hugging Face

0likes4downloads

Model Card

RevisionPhoLexical_46kClsXlm

This model is a fine-tuned version of vinai/phobert-base-v2 on an unknown dataset. It achieves the following results on the evaluation set:

—Loss: 0.5061
—Accuracy: 0.8825
—F1: 0.8734

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 2e-05
—trainbatchsize: 64
—evalbatchsize: 64
—seed: 42
—optimizer: Use OptimizerNames.ADAMWTORCHFUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
—lrschedulertype: linear
—num_epochs: 15

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	F1
No log	0.2770	200	0.3536	0.8421	0.8212
No log	0.5540	400	0.3151	0.8626	0.8501
No log	0.8310	600	0.3134	0.8657	0.8511
0.3827	1.1080	800	0.2956	0.8731	0.8646
0.3827	1.3850	1000	0.3181	0.8544	0.8486
0.3827	1.6620	1200	0.2790	0.8799	0.8669
0.3827	1.9391	1400	0.2829	0.8842	0.8740
0.2944	2.2161	1600	0.2980	0.8761	0.8694
0.2944	2.4931	1800	0.2609	0.8902	0.8809
0.2944	2.7701	2000	0.2730	0.8894	0.8806
0.2474	3.0471	2200	0.2697	0.8870	0.8770
0.2474	3.3241	2400	0.2745	0.8902	0.8792
0.2474	3.6011	2600	0.2793	0.8791	0.8729
0.2474	3.8781	2800	0.2811	0.8909	0.8831
0.2133	4.1551	3000	0.2935	0.8824	0.8754
0.2133	4.4321	3200	0.2933	0.8818	0.8745
0.2133	4.7091	3400	0.2637	0.8946	0.8866
0.2133	4.9861	3600	0.2755	0.8903	0.8811
0.1816	5.2632	3800	0.3032	0.8901	0.8819
0.1816	5.5402	4000	0.2947	0.8880	0.8799
0.1816	5.8172	4200	0.3152	0.8898	0.8814
0.1586	6.0942	4400	0.3265	0.8863	0.8758
0.1586	6.3712	4600	0.3281	0.8889	0.8804
0.1586	6.6482	4800	0.3165	0.8826	0.8748
0.1586	6.9252	5000	0.3223	0.8841	0.8757
0.1319	7.2022	5200	0.3442	0.8855	0.8761
0.1319	7.4792	5400	0.3446	0.8850	0.8763
0.1319	7.7562	5600	0.3693	0.8838	0.8758
0.1117	8.0332	5800	0.3656	0.8847	0.8762
0.1117	8.3102	6000	0.4003	0.8817	0.8723
0.1117	8.5873	6200	0.3653	0.8851	0.8766
0.1117	8.8643	6400	0.3681	0.8853	0.8755
0.0958	9.1413	6600	0.4127	0.8819	0.8743
0.0958	9.4183	6800	0.4260	0.8854	0.8752
0.0958	9.6953	7000	0.3977	0.8824	0.8734
0.0958	9.9723	7200	0.4259	0.8832	0.8731
0.0804	10.2493	7400	0.4388	0.8803	0.8725
0.0804	10.5263	7600	0.4382	0.8852	0.8770
0.0804	10.8033	7800	0.4366	0.8895	0.8802
0.0722	11.0803	8000	0.4413	0.8859	0.8769
0.0722	11.3573	8200	0.4370	0.8846	0.8747
0.0722	11.6343	8400	0.4617	0.8869	0.8771
0.0722	11.9114	8600	0.4390	0.8850	0.8756
0.0657	12.1884	8800	0.4775	0.8845	0.8755
0.0657	12.4654	9000	0.4720	0.8843	0.8751
0.0657	12.7424	9200	0.4923	0.8821	0.8737
0.0564	13.0194	9400	0.4966	0.8804	0.8725
0.0564	13.2964	9600	0.4898	0.8856	0.8770
0.0564	13.5734	9800	0.4989	0.8822	0.8739
0.0564	13.8504	10000	0.4954	0.8821	0.8724
0.0499	14.1274	10200	0.5002	0.8840	0.8753
0.0499	14.4044	10400	0.5102	0.8819	0.8734
0.0499	14.6814	10600	0.5077	0.8825	0.8733
0.0499	14.9584	10800	0.5061	0.8825	0.8734

Framework versions

—Transformers 5.3.0
—Pytorch 2.9.0+cu126
—Datasets 4.0.0
—Tokenizers 0.22.2