Modelpublic

alexandrualexandru/id-to-word-text-to-sparql-combined-dataset-t5-base-2023-06-05_10-17

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

0likes16downloads

Model Card

id-to-word-text-to-sparql-combined-dataset-t5-base-2023-06-05_10-17

This model is a fine-tuned version of t5-base on the None dataset. It achieves the following results on the evaluation set:

—Loss: 0.0967
—Gen Len: 19.0
—Bertscorer-p: 0.5394
—Bertscorer-r: 0.0838
—Bertscorer-f1: 0.3018
—Sacrebleu-score: 6.1241
—Sacrebleu-precisions: [85.81458995625881, 77.51652857152274, 70.6216101009804, 65.87751712684243]
—Bleu-bp: 0.0821

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 0.0003
—trainbatchsize: 8
—evalbatchsize: 8
—seed: 42
—optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
—lrschedulertype: linear
—num_epochs: 2

Training results

Training Loss	Epoch	Step	Validation Loss	Gen Len	Bertscorer-p	Bertscorer-r	Bertscorer-f1	Sacrebleu-score	Sacrebleu-precisions	Bleu-bp
0.1551	1.0	7822	0.1181	19.0	0.5184	0.0626	0.2806	5.3591	[84.89762821812285, 75.22766194579607, 67.4283498216825, 62.37205047209708]	0.0744
0.1049	2.0	15644	0.0967	19.0	0.5394	0.0838	0.3018	6.1241	[85.81458995625881, 77.51652857152274, 70.6216101009804, 65.87751712684243]	0.0821

Framework versions

—Transformers 4.29.2
—Pytorch 2.0.1+cu118
—Datasets 2.12.0
—Tokenizers 0.13.3