Datasetpublic

EleutherAI/dclm-dedup-25B

The first 25,000,003,108 tokens of Zyphra/dclm-dedup. Tokenized using the NeoX tokenizer (EleutherAI/gpt-neox-20b).

sourceHugging Faceupdated 2y agoView on Hugging Face

2likes722downloads

8 commits on main

588a7d32y ago

Update README.md

Kyle1668

585792d2y ago

Upload dataset (part 00004-of-00005)

Kyle1668

f06d85f2y ago

Upload dataset (part 00003-of-00005)

Kyle1668

7508c0a2y ago

Upload dataset (part 00002-of-00005)

Kyle1668

2ede6032y ago

Upload dataset (part 00001-of-00005)

Kyle1668

7e77bdc2y ago

Upload dataset (part 00000-of-00005)

Kyle1668

b99a9502y ago

Create README.md

Kyle1668

6ac5b082y ago

initial commit

Kyle1668