Datasetpublic

stanford-crfm/heuristic_classification-filtered-pile-50M

Dataset Card for heuristic_classification-filtered-pile-50M Dataset Summary This dataset is a subset of The Pile, selected via the heuristic classification data selection method. The target distribution for heuristic classification are the Wikipedia and BookCorpus2 subsets of The Pile. Languages English (EN) Dataset Structure A train set is provided (51.2M examples) in jsonl format. Data Instances {"contents": "Members… See the full description on the dataset page: https://huggingface.co/datasets/stanford-crfm/heuristic_classification-filtered-pile-50M.

sourceHugging Facemitupdated 3y agoView on Hugging Face

1likes103downloads

root

file.gitattributes3 KBdownload

fileREADME.md4 KBdownload

filetrain_1.jsonl8.05 GBdownload

filetrain_10.jsonl80.7 MBdownload

filetrain_11.jsonl80.5 MBdownload

filetrain_2.jsonl8.05 GBdownload

filetrain_3.jsonl8.05 GBdownload

filetrain_4.jsonl8.05 GBdownload

filetrain_5.jsonl8.05 GBdownload

filetrain_6.jsonl8.05 GBdownload

filetrain_7.jsonl8.05 GBdownload

filetrain_8.jsonl8.06 GBdownload

filetrain_9.jsonl16.10 GBdownload

stanford-crfm/heuristic_classification-filtered-pile-50M · main · files are served by the source, never re-hosted here