Nemotron-Cascade
Nemotron-Cascade-2-SFT-Data
Nemotron-Cascade-2-SFT-Data
We release the SFT data used for training Nemotron-Cascade-2.
Data sources
Math
Our non-proof math prompts are sourced from Nemotron-Cascade-1-SFT and Nemotron-Math-v2, with responses generated by DeepSeek-V3.2, DeepSeek-V3.2-Speciale, and GPT-OSS-120B. For mathematical proofs, prompts are taken from Nemotron-Math-Proofs-v1 and generated using DeepSeek-V3.2-Speciale.
Science
We collect science prompts from… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-Cascade-2-SFT-Data.Nemotron-Cascade-SFT-Stage-2
Nemotron-Cascade-SFT-Stage-2
Supervised fine-tuning (SFT) for Nemotron-Cascade is performed in two stages. The Stage-1 SFT focuses on the math, code, science, and general domains, leveraging a broad and diverse collection of data sources. The Stage-2 SFT further expands coverage to include math, code, science, tool calling, software engineering (SWE), instruction following, and general domains.
In Stage-2, the math domain leverages questions from OpenMathReasoning. The code domain… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-Cascade-SFT-Stage-2.Nemotron-Cascade-2-RL-data
Dataset Description:
The Nemotron-Cascade-2-RL dataset is a curated reinforcement learning (RL) dataset blend used to train Nemotron-Cascade-2-30B-A3B model. It includes instruction-following RL, multi-domain RL, on-policy distillation, and software engineering RL (SWE-RL) data.
This dataset is ready for commercial use.
The dataset contains the following subset:
IF-RL
Contains 45,879 training samples for instruction-following RL. Our curation process mainly… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-Cascade-2-RL-data.Nemotron-Cascade-SFT-Stage-1
Nemotron-Cascade-SFT-Stage-1
Supervised fine-tuning (SFT) for Nemotron-Cascade is performed in two stages. The Stage-1 SFT focuses on the math, code, science, and general domains, leveraging a broad and diverse collection of data sources. The Stage-2 SFT further expands coverage to include math, code, science, tool calling, software engineering (SWE), instruction following, and general domains.
In Stage-1, the math domain incorporates questions from OpenMathReasoning and… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-Cascade-SFT-Stage-1.Nemotron-Cascade-RL-SWE
Dataset Description:
The Nemotron-Cascade-RL-SWE dataset is the RL training data for SWE code repairing task, consisting of SWE-Bench-Train, SWE-reBench, SWE-Smith, R2E-Gym/R2E-Gym-Subset and SWE-Fixer-Train.
We select the training data for SFT and RL stages based on its difficulty.
Also, to avoid data contamination, we exclude all instances originating from repositories present in the SWE-Bench_Verified evaluation dataset.
We create the prompts following the agentless mini… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-Cascade-RL-SWE.Nemotron-Cascade-SFT-SWE
Dataset Description:
The Nemotron-Cascade-SFT-SWE dataset is the RL training data for SWE code repairing task, consisting of SWE-Bench-Train, SWE-reBench, SWE-Smith, R2E-Gym/R2E-Gym-Subset and SWE-Fixer-Train.
We select the training data for SFT and RL stages based on its difficulty.
Also, to avoid data contamination, we exclude all instances originating from repositories present in the SWE-Bench_Verified evaluation dataset.
We create the prompts following the agentless mini… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-Cascade-SFT-SWE.