datajuicer/the-pile-nih-refined-by-data-juicer

The Pile -- NIHExPorter (refined by Data-Juicer) A refined version of NIHExPorter dataset in The Pile by Data-Juicer. Removing some "bad" samples from the original dataset to make it higher-quality. This dataset is usually used to pretrain a Large Language Model. Notice: Here is a small subset for previewing. The whole dataset is available here (About 2.0G). Dataset Information Number of samples: 858,492 (Keep ~91.36% from the original dataset)… See the full description on the dataset page: https://huggingface.co/datasets/datajuicer/the-pile-nih-refined-by-data-juicer.