datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
spider-schema
Dataset Card for Spider Schema
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset contains the 166 databases used in the Spider dataset.
Yale Lily Spider Leaderboards
The leaderboard can be seen at https://yale-lily.github.io/spider
Languages
The text in… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-schema.spider-context-validation
Dataset Card for Spider Context Validation
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset was created to validate spider-fine-tuned LLMs with database context.
Yale Lily Spider Leaderboards
The leaderboard can be seen at https://yale-lily.github.io/spider… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-context-validation.spider_12Samples from Spider 1 and Spider 2 for SQLite.
To have DBs locally for Spider 1 refer to the Getting Started of the official website.
All queries here are tested in the databases in test_database.
To have DBs locally for Spider 2 refer to the Quickstart of the github page (the first point is enough)
spider2-litespider-realistic
Dataset Card for Spider-Releastic
This dataset variant contains only the Spider Realistic dataset used in "Structure-Grounded Pretraining for Text-to-SQL". The dataset is created based on the dev split of the Spider dataset (2020-06-07 version from https://yale-lily.github.io/spider). The authors of the dataset modified the original questions to remove the explicit mention of column names while keeping the SQL queries unchanged to better evaluate the model's capability in aligning… See the full description on the dataset page: https://huggingface.co/datasets/aherntech/spider-realistic.spider-context-instruct
Dataset Card for Spider Context Instruct
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset was created to finetune LLMs in a ### Instruction: and ### Response: format with database context.
Yale Lily Spider Leaderboards
The leaderboard can be seen at… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-context-instruct.spider-dpo-1040
Spider DPO 1040
Spider DPO 1040 is a compact Text-to-SQL training dataset for supervised fine-tuning and Direct Preference Optimization. It contains 1,040 preference pairs derived from frontier-model disagreements on Spider V1, plus 7,000 supervised Spider train examples formatted for LLaMA-Factory.
The dataset was created for the companion LoRA adapter jk200201/qwen2.5-coder-7b-sql-dpo.
Important Evaluation Note
The DPO preference pairs in this repository were… See the full description on the dataset page: https://huggingface.co/datasets/jk200201/spider-dpo-1040.spider-syn
Dataset Card for Sypder-Syn
Spyder-Syn is a human curated variant of the Spider Text-to-SQL database.
The database was created to test the robustness of text-to-SQL models for robustness of synonym substitution.
The source GIT repo for Sypder-Syn is located here: https://github.com/ygan/Spider-Syn
Details regarding the data perterbation methods used and objectives are described in ACL 2021: arXiv
Paper Abstract
Recently, there has been significant progress in… See the full description on the dataset page: https://huggingface.co/datasets/aherntech/spider-syn.spider-rollouts-gaia-tool-web-search-gptoss-120bspider-rollouts-web-search-qwen2.5-7b-gaia-32-examplesGRAST-SQL-Spider
⚠️ This dataset has been deprecated. Please use the updated version below, which includes improved quality checks:https://huggingface.co/datasets/griffith-bigdata/GRAST-SL-evaluation-set
GRAST-SQL Spider Training & Evaluation Dataset
This dataset is processed from the original Spider dataset, with extracted schema information and used_columns from SQL queries. It is prepared solely for training, and evaluating schema filtering in the context of the GRAST-SQL paper.… See the full description on the dataset page: https://huggingface.co/datasets/griffith-bigdata/GRAST-SQL-Spider.spider-natsql-context-instruct
Dataset Card for Spider NatSQL Context Instruct
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset was created to finetune LLMs on the Spider dataset with database context using NatSQL.
NatSQL
NatSQL is an intermediate representation for SQL that simplifies the… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-natsql-context-instruct.sql-create-context-spider-intersectspider-queries-trainspider-text-2-sqlspider-skeleton-context-instruct
Dataset Card for Spider Skeleton Context Instruct
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset was created to finetune LLMs in a ### Instruction: and ### Response: format with database context.
Yale Lily Spider Leaderboards
The leaderboard can be seen at… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-skeleton-context-instruct.dbbench-spider-3500
DBBench-Spider-3500
AgentBench DBBench 評価ハーネスと完全互換のフォーマットで生成した SFT 訓練データセット。
Spider データセット (Yale NLP) の 3,500 問を GPT-OSS-120B (Groq) に解かせ、正解したトラジェクトリ 1,697 件 を収録。
混合利用を想定: 本データセットは mark-22/dbbench_cleaned_for_agentbench（1,200 件）と混合し、合計 2,897 件 の SFT データとして使用することを想定しています。
Dataset Summary
Metric
Value
Total trajectories
1,697
Difficulty: Medium
1,406
Difficulty: Hard
291
Avg messages per item
13.2
Unique databases (db_id)
159
Source questions3… See the full description on the dataset page: https://huggingface.co/datasets/mark-22/dbbench-spider-3500.spider-cotspider-context-validation-ranked-schema
Dataset Card for Spider Context Validation
Ranked Schema by ChatGPT
The database context used here is generated from ChatGPT after telling it to reorder the schema with the most relevant columns in the beginning of the db_info.
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-context-validation-ranked-schema.spider_SQL_PALM_PromptDataset for creating prompts for fine-tuning on Spider Dataset with Foreign and Primary Key Information as well as Schema information.
magesql-spider-derived
MageSQL — Spider-derived data and model
These files are derived from / adapted from the
Spider dataset (Yu et al., 2018), which is
distributed under
CC BY-SA 4.0.
Modifications by Megagon Labs, Inc.: merged the Spider train splits
(train_spider_and_others.json), extracted database schema text
(db_id2schema_text.json), mapped questions to gold SQL (question2sql.json),
generated question embeddings (question_embeddings.pt), and trained the
database-routing classifier… See the full description on the dataset page: https://huggingface.co/datasets/megagonlabs/magesql-spider-derived.spider-natsql-context-validation
Dataset Card for Spider NatSQL Context Validation
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset was created to validate LLMs on the Spider dev dataset with database context using NatSQL.
NatSQL
NatSQL is an intermediate representation for SQL that simplifies… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-natsql-context-validation.GRAST-SQL-Spider2.0-lite
⚠️ This dataset has been deprecated. Please use the updated version below, which includes improved quality checks:https://huggingface.co/datasets/griffith-bigdata/GRAST-SL-evaluation-set
GRAST-SQL Spider2.0-Lite Evaluation Dataset
This dataset is processed from the Spider2.0-Lite public set, with extracted schema information and used_columns from SQL queries. It is prepared solely for evaluating schema filtering in the context of the GRAST-SQL paper.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/griffith-bigdata/GRAST-SQL-Spider2.0-lite.spider2-aifuncSpider2-AIFunc
A benchmark for AI-Native Text-to-SQL with Snowflake Cortex AISQL
Spider2-AIFunc extends Spider 2.0 and Spider2-Snow with real-world tasks that require Snowflake Cortex AISQL functions inside SQL queries.
This dataset contains the released task metadata:
data/spider2-aifunc.jsonl: 393 tasks with natural-language instructions, database IDs, target AISQL functions, external-knowledge references, and evaluation configs.
Gold SQL, gold execution results… See the full description on the dataset page: https://huggingface.co/datasets/tianyang/spider2-aifunc.fixed_spider
Cleaned Spider Dataset for Text2SQL
Dataset Summary
The Cleaned Spider Dataset for Text2SQL is an improved version of the original Spider dataset, which is a large-scale, complex, and cross-domain semantic parsing
and text-to-SQL dataset. This enhanced version addresses several critical issues found in the original dataset, ensuring higher quality and reliability for training
text-to-SQL models. The enhancements were made possible through Turbular's advanced data… See the full description on the dataset page: https://huggingface.co/datasets/Turbular/fixed_spider.querysmith-spider-bird
querysmith-spider-bird
Schema-grounded text-to-SQL training data used to fine-tune
ajayk007/Qwen2.5-Coder-7B-Querysmith.
~13.7k examples derived from Spider and
BIRD.
Format
mlx-lm chat format, one example per line:
{"messages": [
{"role": "system", "content": "You are a text-to-SQL generator ..."},
{"role": "user", "content": "Schema:\nCREATE TABLE ...\n\nQuestion: ..."},
{"role": "assistant", "content": "SELECT ..."}
]}
The user turn contains the… See the full description on the dataset page: https://huggingface.co/datasets/ajayk007/querysmith-spider-bird.spiderspider-queries-validationschema-summarization_spider
Dataset Card for schema-summarization_spider
Dataset Description
Dataset Summary
This dataset has been built to train and benchmark models uppon the schema-summarization task. This task aims to generate the smallest schema needed to answer a NL question with the help of the original database schema.
This dataset has been build by crossing these two datasets :
xlangai/spider
richardr1126/spider-schema
With the first dataset we take the natural language… See the full description on the dataset page: https://huggingface.co/datasets/avinot/schema-summarization_spider.spider-natsql-skeleton-context-instruct
Dataset Card for Spider NatSQL Context Instruct
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset was created to finetune LLMs on the Spider dataset with database context using NatSQL.
NatSQL
NatSQL is an intermediate representation for SQL that simplifies the… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-natsql-skeleton-context-instruct.