k8-dmi3eva/spiderology
What is it? Dataset for evaluation text-to-sql models based on Spider dataset. It is divided into 32 groups (testsets) of samples. Each group checks some models ability. For each group there is control group (simplyset) - the same samples, but without considering features. This is very similar to A/B-testing technic. All the simplified samples (from control group) are new. Test samples contains: Examples extracted from Spider (not only from "dev", but also from "train" and… See the full description on the dataset page: https://huggingface.co/datasets/k8-dmi3eva/spiderology.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face