datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
spider
Dataset Card for Spider
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students.
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
Supported Tasks and Leaderboards
The leaderboard can be seen at https://yale-lily.github.io/spider
Languages
The text in the dataset is in English.
Dataset Structure
Data… See the full description on the dataset page: https://huggingface.co/datasets/xlangai/spider.spider-data
Spider Dataset
This project uses the Spider training and development datasets from the EMNLP 2018 paper Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task.
Dataset Files
train_spider.json
Training Examples: 7000
Databases: 140
train_others.json
Training Examples: 1659
Databases: 6
dev.json
Training Examples: 1034
Databases: 20
tables.json
Databases: 166
dev_gold.sql
train_gold.sql
database/… See the full description on the dataset page: https://huggingface.co/datasets/minktn/spider-data.SpIDER-Bench
SpIDER-Bench
Repository dependency graphs for software issue localization — the graph data behind
SpIDER: Spatially Informed Dense Embedding Retrieval for Software Issue Localization
(arXiv:2512.16956).
Each benchmark instance gets one directed multigraph of its repository at the commit the
issue was filed against. Nodes are directories, files, classes and functions carrying
their source; edges are contains / imports / inherits / invokes relations between
them. SpIDER uses these… See the full description on the dataset page: https://huggingface.co/datasets/AmazonScience/SpIDER-Bench.spider
Spider Unified dataset
Documentation comming soon
marvels-spider-man-2-gameplay-data
漫威蜘蛛侠2
This public dataset repository contains local gameplay data uploaded from F:\漫威蜘蛛侠2.
Contents
Files: 713
Total local size: 448.48 GB
Generated: 2026-06-10 23:44:56 UTC
File Types
.jsonl: 217
.json: 168
.png: 163
.txt: 54
.mkv: 54
.parquet: 53
.jpg: 4
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/marvels-spider-man-2-gameplay-data.spider_mcqa_v0.2_full
Spider-MCQA
Converted Spider Text-to-SQL (Paper: Yu et al., 2018; HF Dataset) test set into multiple-choice.
The dataset contains 1,034 examples.
Dataset Fields
Each JSON record contains:
query: the schema and natural-language question prompt.
gold_answer: the correct SQL answer.
options: four SQL answer options, including the gold answer and three generated distractors.
correct_option_index: the index of the correct answer in options.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/notpaulmartin/spider_mcqa_v0.2_full.spider-schema
Dataset Card for Spider Schema
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset contains the 166 databases used in the Spider dataset.
Yale Lily Spider Leaderboards
The leaderboard can be seen at https://yale-lily.github.io/spider
Languages
The text in… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-schema.spider-databases
Spider Databases (SQLite)
A re-host of the SQLite databases from the Spider
text-to-SQL benchmark (Yu et al., 2018), packaged as spider_data.zip so it can be pinned by
commit SHA and verified by checksum.
The standard xlangai/spider parquet ships only the question/SQL pairs — not the databases
needed to execute queries. This repo fills that gap for reproducible execution-based evaluation.
Contents: spider_data/database/<db_id>/<db_id>.sqlite, spider_data/tables.json, and the… See the full description on the dataset page: https://huggingface.co/datasets/HAL-9001/spider-databases.spider_datasetsSpider-Rawspider-corpus-trainLink to original dataset: https://yale-lily.github.io/spider
Yu, T., Zhang, R., Yang, K., Yasunaga, M., Wang, D., Li, Z., Ma, J., Li, I., Yao, Q., Roman, S. and Zhang, Z., 2018. Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task. arXiv preprint arXiv:1809.08887.
spider-corpusLink to original dataset: https://yale-lily.github.io/spider
Yu, T., Zhang, R., Yang, K., Yasunaga, M., Wang, D., Li, Z., Ma, J., Li, I., Yao, Q., Roman, S. and Zhang, Z., 2018. Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task. arXiv preprint arXiv:1809.08887.
spider-ko
Dataset Card for spider-ko: 한국어 Text-to-SQL 데이터셋
데이터셋 요약
Spider-KO는 Yale University의 Spider 데이터셋을 한국어로 번역한 텍스트-SQL 변환 데이터셋입니다. 원본 Spider 데이터셋의 자연어 질문을 한국어로 번역하여 구성하였습니다. 이 데이터셋은 다양한 도메인의 데이터베이스에 대한 질의와 해당 SQL 쿼리를 포함하고 있으며, 한국어 Text-to-SQL 모델 개발 및 평가에 활용될 수 있습니다.
지원 태스크 및 리더보드
text-to-sql: 한국어 자연어 질문을 SQL 쿼리로 변환하는 태스크에 사용됩니다.
언어
데이터셋의 질문은 한국어(ko)로 번역되었으며, SQL 쿼리는 영어 기반으로 유지되었습니다. 원본 영어 질문도 함께 제공됩니다.
데이터셋 구조
데이터 필드
db_id… See the full description on the dataset page: https://huggingface.co/datasets/huggingface-KREW/spider-ko.SPIDER
SPIDER — Lumbar Spine Segmentation in MR Images
Public release of the SPIDER dataset: 218 patients, 447 sagittal lumbar-spine MRI series with reference segmentations of vertebrae, intervertebral discs (IVDs), and spinal canal. Source: van der Graaf et al., Scientific Data 11:264 (2024).
Contents
Path
Description
images/images/
447 .mha MRI volumes — naming `{patient_id}_{t1
masks/masks/
447 .mha reference segmentations, one per image
overview.csv… See the full description on the dataset page: https://huggingface.co/datasets/MedOtter/SPIDER.spider-tableQA
Dataset Card for "spider-tableQA"
Usage
import pandas as pd
from datasets import load_dataset
spider_tableQA = load_dataset("vaishali/spider-tableQA")
for sample in spider_tableQA['train']:
question = sample['question']
sql_query = sample['query']
input_table_names = sample["table_names"]
input_tables = [pd.read_json(table, orient='split') for table in sample['tables']]
answer = pd.read_json(sample['answer'], orient='split')
# flattened input/output… See the full description on the dataset page: https://huggingface.co/datasets/vaishali/spider-tableQA.SPIDER-colorectal
SPIDER-COLORECTAL Dataset
SPIDER is a collection of supervised pathological datasets covering multiple organs, each with comprehensive class coverage. These datasets are professionally annotated by pathologists.
If you would like to support, sponsor, or obtain a commercial license for the SPIDER data and models, please contact us at models@hist.ai.
For a detailed description of SPIDER, methodology, and benchmark results, refer to our research paper:
📄 SPIDER: A Comprehensive… See the full description on the dataset page: https://huggingface.co/datasets/histai/SPIDER-colorectal.Spider-FLEXITOKENS-FP8
Spider-FLEXITOKENS FP8 Training
FP8 training pipeline for Spider-FLEXITOKENS on NVIDIA Blackwell GPUs (sm_120) using torchao Float8Linear and optional TileKernels fused MoE routing.
Architecture
Spider is a Recurrent-Depth Transformer (RDT) with:
1B parameters (996M), hidden_size=2048
Byte-level vocab: 272 tokens (256 UTF-8 bytes + 16 specials: BOS=257, EOS=258, PAD=256)
6 recurrent layers with MoE (32 experts, top-2 routing) + MLA attention
2 prelude + 2 coda dense… See the full description on the dataset page: https://huggingface.co/datasets/CLIWorks/Spider-FLEXITOKENS-FP8.spider
Dataset Card for "spider"
More Information needed
spider-text-to-sql
Spider Text-to-SQL with LLM-Judge Labels
This dataset extends Spider 1.0 with SQL predictions from gpt-5.4-mini and two correctness labels per example: a hybrid ground truth label and an LLM judge label from gpt-5.4.
Files
File
Description
spider_dataset.parquet
Full dataset with predictions and labels
scripts/
Reproduction scripts (see below)
Dataset statistics
Source: Spider 1.0 training split (train_spider.json)
Databases: the… See the full description on the dataset page: https://huggingface.co/datasets/Glide-py/spider-text-to-sql.spider-context-validation
Dataset Card for Spider Context Validation
Dataset Summary
Spider is a large-scale complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 Yale students
The goal of the Spider challenge is to develop natural language interfaces to cross-domain databases.
This dataset was created to validate spider-fine-tuned LLMs with database context.
Yale Lily Spider Leaderboards
The leaderboard can be seen at https://yale-lily.github.io/spider… See the full description on the dataset page: https://huggingface.co/datasets/richardr1126/spider-context-validation.spider_text_to_sql
Dataset Card for "spider_text_to_sql"
More Information needed
spiderTraining1000-1000SPIDER-skin
SPIDER-SKIN Dataset
SPIDER is a collection of supervised pathological datasets covering multiple organs, each with comprehensive class coverage. These datasets are professionally annotated by pathologists.
If you would like to support, sponsor, or obtain a commercial license for the SPIDER data and models, please contact us at models@hist.ai.
For a detailed description of SPIDER, methodology, and benchmark results, refer to our research paper:
SPIDER: A Comprehensive Multi-Organ… See the full description on the dataset page: https://huggingface.co/datasets/histai/SPIDER-skin.SPIDERThis is a large publicly available multi-center lumbar spine magnetic resonance imaging (MRI) dataset with reference segmentations of vertebrae, intervertebral discs (IVDs), and spinal canal. The dataset includes 447 sagittal T1 and T2 MRI series from 218 studies of 218 patients with a history of low back pain. The data was collected from four different hospitals. There is an additional hidden test set, not available here, used in the accompanying SPIDER challenge on spider.grand-challenge.org. We share this data to encourage wider participation and collaboration in the field of spine segmentation, and ultimately improve the diagnostic value of lumbar spine MRI.
This file also provides the biological sex for all patients and the age for the patients for which this was available. It also includes a number of scanner and acquisition parameters for each individual MRI study. The dataset also comes with radiological gradings found in a separate file for the following degenerative changes:
1. Modic changes (type I, II or III)
2. Upper and lower endplate changes / Schmorl nodes (binary)
3. Spondylolisthesis (binary)
4. Disc herniation (binary)
5. Disc narrowing (binary)
6. Disc bulging (binary)
7. Pfirrman grade (grade 1 to 5).
All radiological gradings are provided per IVD level.
Repository: https://zenodo.org/records/10159290
Paper: https://www.nature.com/articles/s41597-024-03090-wbird_spider_train_text_to_sql
Dataset Card for "bird_spider_train_text_to_sql"
More Information needed
spider-corpus-testLink to original dataset: https://yale-lily.github.io/spider
Yu, T., Zhang, R., Yang, K., Yasunaga, M., Wang, D., Li, Z., Ma, J., Li, I., Yao, Q., Roman, S. and Zhang, Z., 2018. Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task. arXiv preprint arXiv:1809.08887.
spiderology
What is it?
Dataset for evaluation text-to-sql models based on Spider dataset.
It is divided into 32 groups (testsets) of samples. Each group checks some models ability.
For each group there is control group (simplyset) - the same samples, but without considering features.
This is very similar to A/B-testing technic.
All the simplified samples (from control group) are new.
Test samples contains:
Examples extracted from Spider (not only from "dev", but also from "train" and… See the full description on the dataset page: https://huggingface.co/datasets/k8-dmi3eva/spiderology.spider2-localdbguided_marvels_spider_man_2_recordings_01
漫威蜘蛛侠2 raw recordings
This dataset contains raw game recordings managed by Game Data Platform. Access requests require manual approval.
Game ID: game_ae2c5af176e4e2eab106954f144c7b7f
Collection: guided (精数据)
Recordings: 155
Layout: recordings/<recording_id>/<raw component>
spider_12Samples from Spider 1 and Spider 2 for SQLite.
To have DBs locally for Spider 1 refer to the Getting Started of the official website.
All queries here are tested in the databases in test_database.
To have DBs locally for Spider 2 refer to the Quickstart of the github page (the first point is enough)