Modelpublic

Wariano/bsc-bio-ehr-es-vih-juicio_anam_urgen

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

0likes10downloads

Model Card

bsc-bio-ehr-es-vih-juicioanamurgen

This model is a fine-tuned version of PlanTL-GOB-ES/bsc-bio-ehr-es on the None dataset. It achieves the following results on the evaluation set:

—Loss: 0.0364
—Positives Preds: 1040
—Negative Preds: 208738
—Positives Refs: 1961
—Negative Refs: 207817
—Tp: 826
—Fn: 1135
—Fp: 214
—Tn: 207603
—Accuracy: 0.9936
—Precision: 0.7942
—Recall: 0.4212
—F1: 0.5505

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 3e-05
—trainbatchsize: 32
—evalbatchsize: 32
—seed: 42
—optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
—lrschedulertype: linear
—num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Positives Preds	Negative Preds	Positives Refs	Negative Refs	Tp	Fn	Fp	Tn	Accuracy	Precision	Recall	F1
0.0372	1.0	26223	0.0358	1276	208502	1961	207817	888	1073	388	207429	0.9930	0.6959	0.4528	0.5487
0.04	2.0	52446	0.0364	1223	208555	1961	207817	873	1088	350	207467	0.9931	0.7138	0.4452	0.5484
0.037	3.0	78669	0.0362	1251	208527	1961	207817	870	1091	381	207436	0.9930	0.6954	0.4437	0.5417
0.0368	4.0	104892	0.0361	1125	208653	1961	207817	848	1113	277	207540	0.9934	0.7538	0.4324	0.5496
0.0367	5.0	131115	0.0364	1040	208738	1961	207817	826	1135	214	207603	0.9936	0.7942	0.4212	0.5505

Framework versions

—Transformers 4.30.2
—Pytorch 2.0.1+cu117
—Datasets 2.13.1
—Tokenizers 0.13.3