Datasetpublic

semran1/Nemotron-Pretraining-Specialized-v1

Nemotron-Pre-Training-Dataset-v2.1 Dataset Description The Nemotron-Pre-Training-Dataset-v2.1 extends the previously released Nemotron pretraining datasets with refreshed, higher-quality, and more diverse data across math, code, English Common Crawl, and large-scale synthetic corpora. Designed for the NVIDIA Nemotron 3 family of LLMs, the dataset introduces new Common Crawl code extraction, 2.5T new English web… See the full description on the dataset page: https://huggingface.co/datasets/semran1/Nemotron-Pretraining-Specialized-v1.

sourceHugging Faceotherupdated 10mo agoView on Hugging Face

2likes63downloads

root

dirNemotron-Pretraining-InfiniByte-Reasoning/

dirNemotron-Pretraining-Math-Textbooks/

dirNemotron-Pretraining-RQA/

dirNemotron-Pretraining-Scientific-Coding/

dirNemotron-Pretraining-STEM-SFT/

dirNemotron-Pretraining-Wiki-Rewrite/

file.gitattributes2 KBdownload

fileREADME.md24 KBdownload

semran1/Nemotron-Pretraining-Specialized-v1 · main · files are served by the source, never re-hosted here