Datasetpublic

HCAI-Lab-GT/dolma3-6t-sample-100000-docs

dolma3-6t-sample-100000-docs Materialized stratified sample of 100,000 docs per bin (~58k source-shard files, ~186 GB) from the deduplicated 6T Dolma3 corpus. Seed 42, materialized by 128 Modal workers (worker_0000/ through worker_0127/). Layout HCAI-Lab/dolma3-6t-sample-100000-docs/ ├── bin_summary.csv ├── sample_contract.json └── worker_NNNN/ └── soc127__phase1_pool_shared__...__shard_NNNNNNNN.jsonl.zst (~450 files per worker) Dual-access… See the full description on the dataset page: https://huggingface.co/datasets/HCAI-Lab-GT/dolma3-6t-sample-100000-docs.

sourceHugging Faceupdated 4mo agoView on Hugging Face

0likes5.1kdownloads

dirworker_0000/

dirworker_0001/

dirworker_0002/

dirworker_0003/

dirworker_0004/

dirworker_0005/

dirworker_0006/

dirworker_0007/

dirworker_0008/

dirworker_0009/

dirworker_0010/

dirworker_0011/

dirworker_0012/

dirworker_0013/

dirworker_0014/

dirworker_0015/

dirworker_0016/

dirworker_0017/

dirworker_0018/

dirworker_0019/

dirworker_0020/

dirworker_0021/

dirworker_0022/

dirworker_0023/

dirworker_0024/

dirworker_0025/

dirworker_0026/

dirworker_0027/

dirworker_0028/

dirworker_0029/

dirworker_0030/

dirworker_0031/

dirworker_0032/

dirworker_0033/

dirworker_0034/

dirworker_0035/

dirworker_0036/

dirworker_0037/

dirworker_0038/

dirworker_0039/

dirworker_0040/

dirworker_0041/

dirworker_0042/

dirworker_0043/

dirworker_0044/

dirworker_0045/

dirworker_0046/

dirworker_0047/

dirworker_0048/

dirworker_0049/

dirworker_0050/

dirworker_0051/

dirworker_0052/

dirworker_0053/

dirworker_0054/

dirworker_0055/

dirworker_0056/

dirworker_0057/

dirworker_0058/

dirworker_0059/

dirworker_0060/

dirworker_0061/

dirworker_0062/

dirworker_0063/

dirworker_0064/

dirworker_0065/

dirworker_0066/

dirworker_0067/

dirworker_0068/

dirworker_0069/

dirworker_0070/

dirworker_0071/

dirworker_0072/

dirworker_0073/

dirworker_0074/

dirworker_0075/

dirworker_0076/

dirworker_0077/

dirworker_0078/

dirworker_0079/

dirworker_0080/

dirworker_0081/

dirworker_0082/

dirworker_0083/

dirworker_0084/

dirworker_0085/

dirworker_0086/

dirworker_0087/

dirworker_0088/

dirworker_0089/

dirworker_0090/

dirworker_0091/

dirworker_0092/

dirworker_0093/

dirworker_0094/

dirworker_0095/

dirworker_0096/

dirworker_0097/

dirworker_0098/

dirworker_0099/

dirworker_0100/

dirworker_0101/

dirworker_0102/

dirworker_0103/

dirworker_0104/

dirworker_0105/

dirworker_0106/

dirworker_0107/

dirworker_0108/

dirworker_0109/

dirworker_0110/

dirworker_0111/

dirworker_0112/

dirworker_0113/

dirworker_0114/

dirworker_0115/

dirworker_0116/

dirworker_0117/

dirworker_0118/

dirworker_0119/

dirworker_0120/

dirworker_0121/

dirworker_0122/

dirworker_0123/

dirworker_0124/

dirworker_0125/

dirworker_0126/

dirworker_0127/

file.gitattributes2 KBdownload

filebin_summary.csv35 KBdownload

fileREADME.md2 KBdownload

filesample_contract.json489 Bdownload

HCAI-Lab-GT/dolma3-6t-sample-100000-docs · main · files are served by the source, never re-hosted here

HCAI-Lab-GT/dolma3-6t-sample-100000-docs · CoolFace