ashtok897/european-hplt-v1
European HPLT v1 A multilingual pretraining corpus of 45,031,396 documents (~50.9B estimated tokens, ~190 GB raw JSONL) across 41 European languages, built from HPLT Monolingual v3 high-quality web crawl data. The corpus spans Germanic, Romance, Slavic, Celtic, Baltic, Finno-Ugric, Greek, and other European language families. Every document has an HPLT WDS quality score of 10 or higher (the top of the quality distribution). Quick Start from datasets import… See the full description on the dataset page: https://huggingface.co/datasets/ashtok897/european-hplt-v1.
Update README.md (#1)
Delete data/train/train-00107-of-00181.parquet
Upload test/train-00180-of-00181.parquet
Upload test/train-00179-of-00181.parquet
Upload validation/train-00178-of-00181.parquet
Upload validation/train-00177-of-00181.parquet
Upload train/train-00176-of-00181.parquet
Upload train/train-00175-of-00181.parquet
Upload train/train-00174-of-00181.parquet
Upload train/train-00173-of-00181.parquet
Upload train/train-00172-of-00181.parquet
Upload train/train-00171-of-00181.parquet
Upload train/train-00170-of-00181.parquet
Upload train/train-00169-of-00181.parquet
Upload train/train-00168-of-00181.parquet
Upload train/train-00167-of-00181.parquet
Upload train/train-00166-of-00181.parquet
Upload train/train-00165-of-00181.parquet
Upload train/train-00164-of-00181.parquet
Upload train/train-00163-of-00181.parquet
Upload train/train-00162-of-00181.parquet
Upload train/train-00161-of-00181.parquet
Upload train/train-00160-of-00181.parquet
Upload train/train-00159-of-00181.parquet
Upload train/train-00158-of-00181.parquet
Upload train/train-00157-of-00181.parquet
Upload train/train-00156-of-00181.parquet
Upload train/train-00155-of-00181.parquet
Upload train/train-00154-of-00181.parquet
Upload train/train-00153-of-00181.parquet
Upload train/train-00152-of-00181.parquet
Upload train/train-00151-of-00181.parquet
Upload train/train-00150-of-00181.parquet
Upload train/train-00149-of-00181.parquet
Upload train/train-00148-of-00181.parquet
Upload train/train-00147-of-00181.parquet
Upload train/train-00146-of-00181.parquet
Upload train/train-00145-of-00181.parquet
Upload train/train-00144-of-00181.parquet
Upload train/train-00143-of-00181.parquet
Upload train/train-00142-of-00181.parquet
Upload train/train-00141-of-00181.parquet
Upload train/train-00140-of-00181.parquet
Upload train/train-00139-of-00181.parquet
Upload train/train-00138-of-00181.parquet
Upload train/train-00137-of-00181.parquet
Upload train/train-00136-of-00181.parquet
Upload train/train-00135-of-00181.parquet
Upload train/train-00134-of-00181.parquet
Upload train/train-00133-of-00181.parquet