common-pile/raw_v0.1_parquet

Common Pile v0.1 — Parquet Consolidated Description This dataset bundles all “raw” corpora from the Common Pile v0.1 Raw Data collection, converted to Apache Parquet and consolidated in a single repository. Nothing has been filtered or modified; the only changes are: Format: original JSON → Parquet Layout: many repositories → one consolidated dataset Extra column: a len_category bucket for quick length-based filtering Only the three original columns (id… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/raw_v0.1_parquet.