Modelpublic

DrinkIcedT/roberta-large_MBTI_pub_F

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes9downloads

Model Card

roberta-largeMBTIFMBTIaggbalanced501e-050.0

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

—Loss: 3.3595
—F1: 0.7508
—Threshold: 0.72
—F1 At 05: 0.7476

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 1e-05
—trainbatchsize: 16
—evalbatchsize: 16
—seed: 42
—distributed_type: multi-GPU
—num_devices: 4
—totaltrainbatch_size: 64
—totalevalbatch_size: 64
—optimizer: Use OptimizerNames.ADAMWTORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
—lrschedulertype: linear
—lrschedulerwarmup_steps: 400
—num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	F1	Threshold	F1 At 05
2.4054	0.3175	200	2.4386	0.6820	0.3400	0.6294
2.2075	0.6349	400	2.1551	0.7176	0.4100	0.7081
2.0015	0.9524	600	2.0811	0.7456	0.4200	0.7309
1.7704	1.2698	800	2.0022	0.7612	0.4500	0.7564
1.6681	1.5873	1000	2.1312	0.7531	0.62	0.7440
1.5989	1.9048	1200	2.1137	0.7596	0.52	0.7563
1.1537	2.2222	1400	2.2756	0.7580	0.52	0.7563
1.2148	2.5397	1600	2.3888	0.7536	0.38	0.7506
1.1054	2.8571	1800	2.3945	0.7568	0.51	0.7559
0.7455	3.1746	2000	2.9322	0.7480	0.64	0.7454
0.8107	3.4921	2200	2.9185	0.7489	0.4300	0.7479
0.7662	3.8095	2400	2.9712	0.7538	0.66	0.7482
0.5510	4.1270	2600	3.3035	0.7500	0.71	0.7458
0.5237	4.4444	2800	3.2495	0.7480	0.51	0.7468
0.5465	4.7619	3000	3.3595	0.7508	0.72	0.7476

Framework versions

—Transformers 5.3.0
—Pytorch 2.7.1
—Datasets 4.8.5
—Tokenizers 0.22.2