CoolFace
Datasetpublic

trl-lab/schemapile

SchemaPile Usage from datasets import load_dataset ds = load_dataset("trl-lab/schemapile", split="full") print(f"Loaded dataset with {len(ds)} records.") print(ds[0]) Description SchemaPile is a collection of database schemas extracted from various sources, normalized for consistency and ease of use in machine learning workflows. Each record contains metadata (INFO), licensing information, permissiveness, and a list of tables with detailed column… See the full description on the dataset page: https://huggingface.co/datasets/trl-lab/schemapile.

sourceHugging Faceupdated 1y agoView on Hugging Face
2likes232downloads
Dataset Card

SchemaPile

Usage

python
from datasets import load_dataset
ds = load_dataset("trl-lab/schemapile", split="full")
print(f"Loaded dataset with {len(ds)} records.")
print(ds[0])

Description

SchemaPile is a collection of database schemas extracted from various sources, normalized for consistency and ease of use in machine learning workflows. Each record contains metadata (INFO), licensing information, permissiveness, and a list of tables with detailed column specifications.

Schema

  • —INFO:
  • —ID: Unique identifier (from filename prefix)
  • —FILENAME: Original filename
  • —Additional metadata fields
  • —LICENSE: License string (if available)
  • —PERMISSIVE: Boolean indicating permissive license
  • —TABLES: List of tables, each with:
  • —TABLE_NAME: Name of the table
  • —COLUMNS: List of columns, each with:
  • —NAME, TYPE, NULLABLE, UNIQUE, DEFAULT, CHECKS, IS_PRIMARY, IS_INDEX, VALUES
  • —PRIMARY_KEYS, FOREIGN_KEYS, CHECKS, INDEXES

Citation

If you use SchemaPile in your research, please cite:

``bibtex @article{dohmen2024schemapile, title={Schemapile: A large collection of relational database schemas}, author={D{"o}hmen, Till and Geacu, Radu and Hulsebos, Madelon and Schelter, Sebastian}, journal={Proceedings of the ACM on Management of Data}, volume={2}, number={3}, pages={1--25}, year={2024}, publisher={ACM New York, NY, USA} ``

[Read the paper](https://schemapile.github.io/assets/SchemaPile.pdf)

Website

For more information, visit the SchemaPile website.

License

See individual record LICENSE fields for details. The PERMISSIVE flag indicates whether the schema is under a permissive license.