jbduran/bartholomew-dataset-v1
BART Dataset v1 The first version of the BART pretraining corpus: pre-1930 English books drawn from Institutional Books 1.0 and filtered hard on OCR quality, language, date, and tokenizability. Documents 160,263 Characters 118,745,375,871 Tokens ~27B (estimated) Shards 473 (472 train + 1 val) Source Institutional Books 1.0 (242B tokens, ~983K documents) Schema single string column text Lineage — three cumulative filtering stages over the same corpus:… See the full description on the dataset page: https://huggingface.co/datasets/jbduran/bartholomew-dataset-v1.
Add MIT license to dataset card metadata
Rewrite dataset card: BART v-series naming, provenance narrative, lineage links
Update README.md
Update README.md
Add README + manifest
Add 23 shard(s): shard_00450.parquet..shard_00472.parquet
Add 50 shard(s): shard_00400.parquet..shard_00449.parquet
Add 50 shard(s): shard_00350.parquet..shard_00399.parquet
Add 50 shard(s): shard_00300.parquet..shard_00349.parquet
Add 50 shard(s): shard_00250.parquet..shard_00299.parquet
Add 50 shard(s): shard_00200.parquet..shard_00249.parquet
Add 50 shard(s): shard_00150.parquet..shard_00199.parquet
Add 50 shard(s): shard_00100.parquet..shard_00149.parquet
Add 50 shard(s): shard_00050.parquet..shard_00099.parquet
Add 50 shard(s): shard_00000.parquet..shard_00049.parquet
initial commit