datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
spider
Dataset Card for Spider
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students.
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
Supported Tasks and Leaderboards
The leaderboard can be seen at https://yale-lily.github.io/spider
Languages
The text in the dataset is in English.
Dataset Structure
Data… See the full description on the dataset page: https://huggingface.co/datasets/xlangai/spider.SpIDER-Bench
SpIDER-Bench
Repository dependency graphs for software issue localization — the graph data behind
SpIDER: Spatially Informed Dense Embedding Retrieval for Software Issue Localization
(arXiv:2512.16956).
Each benchmark instance gets one directed multigraph of its repository at the commit the
issue was filed against. Nodes are directories, files, classes and functions carrying
their source; edges are contains / imports / inherits / invokes relations between
them. SpIDER uses these… See the full description on the dataset page: https://huggingface.co/datasets/AmazonScience/SpIDER-Bench.spider_mcqa_v0.2_full
Spider-MCQA
Converted Spider Text-to-SQL (Paper: Yu et al., 2018; HF Dataset) test set into multiple-choice.
The dataset contains 1,034 examples.
Dataset Fields
Each JSON record contains:
query: the schema and natural-language question prompt.
gold_answer: the correct SQL answer.
options: four SQL answer options, including the gold answer and three generated distractors.
correct_option_index: the index of the correct answer in options.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/notpaulmartin/spider_mcqa_v0.2_full.spider-schema
Dataset Card for Spider Schema
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset contains the 166 databases used in the Spider dataset.
Yale Lily Spider Leaderboards
The leaderboard can be seen at https://yale-lily.github.io/spider
Languages
The text in… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-schema.Spider-Rawspider-corpusLink to original dataset: https://yale-lily.github.io/spider
Yu, T., Zhang, R., Yang, K., Yasunaga, M., Wang, D., Li, Z., Ma, J., Li, I., Yao, Q., Roman, S. and Zhang, Z., 2018. Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task. arXiv preprint arXiv:1809.08887.
SPIDER
SPIDER — Lumbar Spine Segmentation in MR Images
Public release of the SPIDER dataset: 218 patients, 447 sagittal lumbar-spine MRI series with reference segmentations of vertebrae, intervertebral discs (IVDs), and spinal canal. Source: van der Graaf et al., Scientific Data 11:264 (2024).
Contents
Path
Description
images/images/
447 .mha MRI volumes — naming `{patient_id}_{t1
masks/masks/
447 .mha reference segmentations, one per image
overview.csv… See the full description on the dataset page: https://huggingface.co/datasets/MedOtter/SPIDER.spider-ko
Dataset Card for spider-ko: 한국어 Text-to-SQL 데이터셋
데이터셋 요약
Spider-KO는 Yale University의 Spider 데이터셋을 한국어로 번역한 텍스트-SQL 변환 데이터셋입니다. 원본 Spider 데이터셋의 자연어 질문을 한국어로 번역하여 구성하였습니다. 이 데이터셋은 다양한 도메인의 데이터베이스에 대한 질의와 해당 SQL 쿼리를 포함하고 있으며, 한국어 Text-to-SQL 모델 개발 및 평가에 활용될 수 있습니다.
지원 태스크 및 리더보드
text-to-sql: 한국어 자연어 질문을 SQL 쿼리로 변환하는 태스크에 사용됩니다.
언어
데이터셋의 질문은 한국어(ko)로 번역되었으며, SQL 쿼리는 영어 기반으로 유지되었습니다. 원본 영어 질문도 함께 제공됩니다.
데이터셋 구조
데이터 필드
db_id… See the full description on the dataset page: https://huggingface.co/datasets/huggingface-KREW/spider-ko.spider-tableQA
Dataset Card for "spider-tableQA"
Usage
import pandas as pd
from datasets import load_dataset
spider_tableQA = load_dataset("vaishali/spider-tableQA")
for sample in spider_tableQA['train']:
question = sample['question']
sql_query = sample['query']
input_table_names = sample["table_names"]
input_tables = [pd.read_json(table, orient='split') for table in sample['tables']]
answer = pd.read_json(sample['answer'], orient='split')
# flattened input/output… See the full description on the dataset page: https://huggingface.co/datasets/vaishali/spider-tableQA.SPIDER-colorectal
SPIDER-COLORECTAL Dataset
SPIDER is a collection of supervised pathological datasets covering multiple organs, each with comprehensive class coverage. These datasets are professionally annotated by pathologists.
If you would like to support, sponsor, or obtain a commercial license for the SPIDER data and models, please contact us at models@hist.ai.
For a detailed description of SPIDER, methodology, and benchmark results, refer to our research paper:
📄 SPIDER: A Comprehensive… See the full description on the dataset page: https://huggingface.co/datasets/histai/SPIDER-colorectal.spider-text-to-sql
Spider Text-to-SQL with LLM-Judge Labels
This dataset extends Spider 1.0 with SQL predictions from gpt-5.4-mini and two correctness labels per example: a hybrid ground truth label and an LLM judge label from gpt-5.4.
Files
File
Description
spider_dataset.parquet
Full dataset with predictions and labels
scripts/
Reproduction scripts (see below)
Dataset statistics
Source: Spider 1.0 training split (train_spider.json)
Databases: the… See the full description on the dataset page: https://huggingface.co/datasets/Glide-py/spider-text-to-sql.spider
Dataset Card for "spider"
More Information needed
spider-context-validation
Dataset Card for Spider Context Validation
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset was created to validate spider-fine-tuned LLMs with database context.
Yale Lily Spider Leaderboards
The leaderboard can be seen at https://yale-lily.github.io/spider… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-context-validation.spider_text_to_sql
Dataset Card for "spider_text_to_sql"
More Information needed
spider-corpus-testLink to original dataset: https://yale-lily.github.io/spider
Yu, T., Zhang, R., Yang, K., Yasunaga, M., Wang, D., Li, Z., Ma, J., Li, I., Yao, Q., Roman, S. and Zhang, Z., 2018. Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task. arXiv preprint arXiv:1809.08887.
SPIDER-skin
SPIDER-SKIN Dataset
SPIDER is a collection of supervised pathological datasets covering multiple organs, each with comprehensive class coverage. These datasets are professionally annotated by pathologists.
If you would like to support, sponsor, or obtain a commercial license for the SPIDER data and models, please contact us at models@hist.ai.
For a detailed description of SPIDER, methodology, and benchmark results, refer to our research paper:
SPIDER: A Comprehensive Multi-Organ… See the full description on the dataset page: https://huggingface.co/datasets/histai/SPIDER-skin.bird_spider_train_text_to_sql
Dataset Card for "bird_spider_train_text_to_sql"
More Information needed
guided_marvels_spider_man_2_recordings_01
漫威蜘蛛侠2 raw recordings
This dataset contains raw game recordings managed by Game Data Platform. Access requests require manual approval.
Game ID: game_ae2c5af176e4e2eab106954f144c7b7f
Collection: guided (精数据)
Recordings: 155
Layout: recordings/<recording_id>/<raw component>
spider_12Samples from Spider 1 and Spider 2 for SQLite.
To have DBs locally for Spider 1 refer to the Getting Started of the official website.
All queries here are tested in the databases in test_database.
To have DBs locally for Spider 2 refer to the Quickstart of the github page (the first point is enough)
spider2-litespider-queriesspider-realistic
Dataset Card for Spider-Releastic
This dataset variant contains only the Spider Realistic dataset used in "Structure-Grounded Pretraining for Text-to-SQL". The dataset is created based on the dev split of the Spider dataset (2020-06-07 version from https://yale-lily.github.io/spider). The authors of the dataset modified the original questions to remove the explicit mention of column names while keeping the SQL queries unchanged to better evaluate the model's capability in aligning… See the full description on the dataset page: https://huggingface.co/datasets/aherntech/spider-realistic.spider-context-instruct
Dataset Card for Spider Context Instruct
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset was created to finetune LLMs in a ### Instruction: and ### Response: format with database context.
Yale Lily Spider Leaderboards
The leaderboard can be seen at… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-context-instruct.doe-genesis-sealed-n2500
Demonstration receipts (n=2500)
These are demonstration envelopes from a filing. n=2500 is a demonstration number. Each row is one trajectory summary, not a 1 kHz pulse and not a timeseries. 15 banks (37,500 rows). Per-row proof_hash. File cryptographic_seal.
What a stranger sees if they cite this zip
They land on a grant-shaped shelf: 15 configs next to each other, mass/μ/booleans/proof_hash. No pulse. No 4×4 taxels. No sentence that this is the direction for… See the full description on the dataset page: https://huggingface.co/datasets/spiderpilot89/doe-genesis-sealed-n2500.spider-dpo-1040
Spider DPO 1040
Spider DPO 1040 is a compact Text-to-SQL training dataset for supervised fine-tuning and Direct Preference Optimization. It contains 1,040 preference pairs derived from frontier-model disagreements on Spider V1, plus 7,000 supervised Spider train examples formatted for LLaMA-Factory.
The dataset was created for the companion LoRA adapter jk200201/qwen2.5-coder-7b-sql-dpo.
Important Evaluation Note
The DPO preference pairs in this repository were… See the full description on the dataset page: https://huggingface.co/datasets/jk200201/spider-dpo-1040.spider-tableQA-pretraining
Dataset Card for "spider-tableQA-pretraining"
Usage
import pandas as pd
from datasets import load_dataset
spider_tableQA_pretraining = load_dataset("vaishali/spider-tableQA-pretraining")
for sample in spider_tableQA_pretraining['train']:
sql_query = sample['query']
input_table_names = sample["table_names"]
input_tables = [pd.read_json(table, orient='split') for table in sample['tables']]
answer = pd.read_json(sample['answer'], orient='split')
# flattened… See the full description on the dataset page: https://huggingface.co/datasets/vaishali/spider-tableQA-pretraining.spider-text2sql
SPIDER Text-to-SQL — Easy Access Version
A clean, HuggingFace-native version of the SPIDER Text-to-SQL benchmark. The original SPIDER dataset requires manually downloading a ZIP file from the Spider website. This version makes it instantly accessible via load_dataset.
What's Included
Each row contains the question, gold SQL, the database identifier, and a pre-parsed compact schema string — everything needed to train or evaluate a Text-to-SQL model without any additional… See the full description on the dataset page: https://huggingface.co/datasets/SuperMax991/spider-text2sql.SPIDER-breast
SPIDER-BREAST Dataset
SPIDER is a collection of supervised pathological datasets covering multiple organs, each with comprehensive class coverage. These datasets are professionally annotated by pathologists.
If you would like to support, sponsor, or obtain a commercial license for the SPIDER data and models, please contact us at models@hist.ai.
For a detailed description of SPIDER, methodology, and benchmark results, refer to our research paper:
📄 SPIDER: A Comprehensive… See the full description on the dataset page: https://huggingface.co/datasets/histai/SPIDER-breast.spider_VALUESpider is a large-scale complex and cross-domain semantic parsing and text-toSQL dataset annotated by 11 college studentspip-txt-to-sql-spider-bird-dataset
Dataset Card for "spider-bird"
More Information needed