PleIAs/data_samples
Multimodal Pretraining This section covers our large-scale collections at the source and is distributed in its original form (PDF with layout intact, audio attached to its transcript) rather than as text extracted after the fact. The emphasis is on what large-scale web collection misses: academic global production (badly indexed in scientific repositories); patents outside the US; the technical and regulatory archives of telecom and finance. These are long, structured… See the full description on the dataset page: https://huggingface.co/datasets/PleIAs/data_samples.
Update README.md
Update README.md
Upload SYNTH__neurips_2026.pdf
Update README.md
Update README.md
Update README.md
Add synthetic ethics sample: 100 scenarios x 16 frameworks, structured schema (32 cols)
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Add synthetic social media sample (1k synthetic transit tweets with conditioning and generation reasoning)
Update README.md
Update README.md
Update README.md
Update README.md
Rename epo_patents/ -> global_patents/ (non-US patents; EPO now, Asia in progress)
Delete epo_patents/pdfs/epo_pdfs_2025.tar
Delete epo_patents/pdfs/epo_pdfs_2024.tar
Delete epo_patents/pdfs/epo_pdfs_2023.tar
Delete epo_patents/pdfs/epo_pdfs_2022.tar
Delete epo_patents/pdfs/epo_pdfs_2021.tar
Delete epo_patents/pdfs/epo_pdfs_2020.tar
Delete epo_patents/epo_5k_pdf_manifest.parquet
Delete epo_patents/epo_5k_sections.parquet
EPO sample with embedded PDFs: epo_sample_005.parquet (1000 docs)
EPO sample with embedded PDFs: epo_sample_004.parquet (1000 docs)
EPO sample with embedded PDFs: epo_sample_003.parquet (1000 docs)
EPO sample with embedded PDFs: epo_sample_002.parquet (1000 docs)
EPO sample with embedded PDFs: epo_sample_001.parquet (1000 docs)
telecom sample: rewrite with 20-row row groups (was 5 groups of ~450MB)
Add telecom sample: 734 docs with embedded PDFs (3GPP specs+TSG, IEEE Access, OpenAlex OA, NTIA, World Bank)
Add finance sample (713 docs, metadata + dots.ocr transcript + embedded PDF)
Update README.md
wikidata_seed: drop deprecated-rank statements and unresolved bare QIDs
Update README.md
Update README.md
Delete folder eu_science with huggingface_hub
Update README.md
Update README.md
Update README.md
Update README.md
Upload folder using huggingface_hub
Zero-pad shard numbering (gac_sample_001..011)
Upload folder using huggingface_hub
Upload folder using huggingface_hub
Update README.md
Update README.md
Update README.md
