CoolFace
Modelpublic

semiotic/T5-3B-SynQL-KaggleDBQA-Train-Run-00

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes17downloads
Model Card

Model Card for T5-3B/SynQL-KaggleDBQA-Train-Run-00

Model Context

Example metadata can be found below, context represents the prompt that is presented to the model. Database schemas follow the encoding method proposed by Shaw et al (2020).

"query": "SELECT count(*) FROM singer",
"question": "How many singers do we have?",
"context": "How many singers do we have? | concert_singer | stadium : stadium_id, location, name, capacity, highest, lowest, average | singer : singer_id, name, country, song_name, song_release_year, age, is_male | concert : concert_id, concert_name, theme, stadium_id, year | singer_in_concert : concert_id, singer_id",
"db_id": "concert_singer",

Model Results

Evaluation set: KaggleDBQA/test

Evaluation metrics: [Execution Accuracy]

ModelDataRunExecution Accuracy
T5-3Bsemiotic/SynQL-KaggleDBQA000.3514
T5-3Bsemiotic/SynQL-KaggleDBQA010.3514
T5-3Bsemiotic/SynQL-KaggleDBQA020.3514