Datasetpublic

togethercomputer/RedPajama-Data-V2

RedPajama V2: an Open Dataset for Training Large Language Models

sourceHugging Faceupdated 2y agoView on Hugging Face

408likes12kdownloads

revisionmain deduplicate_flag

file_CC_SNAPSHOT_IDS672 Bdownload

file.gitattributes59 KBdownload

file.gitignore299 Bdownload

fileREADME.md42 KBdownload

fileRedPajama-Data-V2.py14 KBdownload

fileut1_domain_categories.json651 KBdownload

togethercomputer/RedPajama-Data-V2 · main · files are served by the source, never re-hosted here