ramachetan22/sql-create-context-v2

1---2license: cc-by-sa-3.03---4# sql-create-context-v2 Dataset5 6## Overview7 8The `sql-create-context-v2` dataset enhances the original dataset built from WikiSQL and Spider, focusing on text-to-SQL tasks with a special emphasis on reducing hallucination of column and table names. This version introduces a JSONL format for more efficient data processing and iteration, alongside a structured approach to representing SQL queries in the dataset entries.9 10### Key Enhancements11 12- **Dataset Format:** Transitioned to JSON Lines (JSONL) format for improved handling of large datasets and streamlined processing of individual records.13- **Structured Query Representation:** Each SQL query answer is now encapsulated within an object keyed by `SQL_Query`, facilitating clearer separation between the query text and other metadata.14 15## Sample Entries16 17```json18{19  "question": "Please show the themes of competitions with host cities having populations larger than 1000.",20  "context": "CREATE TABLE city (City_ID VARCHAR, Population INTEGER); CREATE TABLE farm_competition (Theme VARCHAR, Host_city_ID VARCHAR)",21  "answer": {"SQL_Query": "SELECT T2.Theme FROM city AS T1 JOIN farm_competition AS T2 ON T1.City_ID = T2.Host_city_ID WHERE T1.Population > 1000"}22},23{24  "question": "Please show the different statuses of cities and the average population of cities with each status.",25  "context": "CREATE TABLE city (Status VARCHAR, Population INTEGER)",26  "answer": {"SQL_Query": "SELECT Status, AVG(Population) FROM city GROUP BY Status"}27}28 29```30 31Citing this Work32If you use the sql-create-context-v2 dataset, please cite the following in addition to the original works:33 34 35 36```bibtex37@misc{sql-create-context-v2_2024,38  title   = {sql-create-context-v2 Dataset},39  author  = Rama Chetan Atmudi,40  year    = {2024},41  url     = {https://huggingface.co/datasets/ramachetan22/sql-create-context-v2},42  note    = {Enhancements and modifications to the original sql-create-context dataset for improved usability and processing.}43}44```45 46 47Datasets Used to Create This Dataset48 49```bibtex50@misc{b-mc2_2023_sql-create-context,51  title   = {sql-create-context Dataset},52  author  = {b-mc2}, 53  year    = {2023},54  url     = {https://huggingface.co/datasets/b-mc2/sql-create-context},55  note    = {This dataset was created by modifying data from the following sources: \cite{zhongSeq2SQL2017, yu2018spider}.},56}57```58 59```bibtex60Datasets used to create this dataset61@article{zhongSeq2SQL2017,62  author  = {Victor Zhong and Caiming Xiong and Richard Socher},63  title   = {Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning},64  journal = {CoRR},65  volume  = {abs/1709.00103},66  year    = {2017}67}68```69 70```bibtex71@article{yu2018spider,72  title   = {Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task},73  author  = {Yu, Tao and Zhang, Rui and Yang, Kai and Yasunaga, Michihiro and Wang, Dongxu and Li, Zifan and Ma, James and Li, Irene and Yao, Qingning and Roman, Shanelle and others},74  journal = {arXiv preprint arXiv:1809.08887},75  year    = {2018}76}77```