k8-dmi3eva/spiderology

What is it? Dataset for evaluation text-to-sql models based on Spider dataset. It is divided into 32 groups (testsets) of samples. Each group checks some models ability. For each group there is control group (simplyset) - the same samples, but without considering features. This is very similar to A/B-testing technic. All the simplified samples (from control group) are new. Test samples contains: Examples extracted from Spider (not only from "dev", but also from "train" and… See the full description on the dataset page: https://huggingface.co/datasets/k8-dmi3eva/spiderology.