bird-bench
birdbench
BirdBench Dataset
Documentation of how to use this using huggingface datasets coming soon.
birdbench-duckdb
BirdBench Dataset in DuckDB format
BirdBench is a benchmark for text-to-SQL capabilities, now available in DuckDB format for improved performance and usability.
About BirdBench
BirdBench is a comprehensive benchmark dataset for evaluating text-to-SQL capabilities of language models. It features a diverse collection of databases spanning various domains including:
Business and finance
Entertainment and media
Sports and recreation
Health and medicine
Education
Travel and… See the full description on the dataset page: https://huggingface.co/datasets/ucalyptus/birdbench-duckdb.bird-corpus-validationlink to original dataset: https://bird-bench.github.io/
Li, J., Hui, B., Qu, G., Yang, J., Li, B., Li, B., Wang, B., Qin, B., Geng, R., Huo, N. and Zhou, X., 2024. Can llm already serve as a database interface? a big bench for large-scale database grounded text-to-sqls. Advances in Neural Information Processing Systems, 36.
BIRD-benchbirdbench
BirdBench Dataset
Documentation of how to use this using huggingface datasets coming soon.
bird-corpusbibtex ref
@article{li2024can,
title={Can llm already serve as a database interface? a big bench for large-scale database grounded text-to-sqls},
author={Li, Jinyang and Hui, Binyuan and Qu, Ge and Yang, Jiaxi and Li, Binhua and Li, Bowen and Wang, Bailin and Qin, Bowen and Geng, Ruiying and Huo, Nan and others},
journal={Advances in Neural Information Processing Systems},
volume={36},
year={2024}
}