daviddavidlu/DAPO-with-prompt-augmentation-step2820

Model Card for PrAg-PO Qwen2.5-Math-1.5B step2820 (Outdated)

If you are using the model, a star to our [github repo](https://github.com/wenquanlu/PrAg-PO) would be really appreciated! 😊

For more checkpoints with better performance, please refer to [step 2720](https://huggingface.co/daviddavidlu/DAPO-with-prompt-augmentation-step2720) and [step 2480](https://huggingface.co/daviddavidlu/DAPO-with-prompt-augmentation-step2480)

This is the step 2820 checkpoint when training Qwen2.5-Math-1.5B on MATH Level-3-to-5 Dataset using PrAg-PO. The training procedure is outlined in the paper PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning.

Model Sources

• —Repository 🤖: https://github.com/wenquanlu/PrAg-PO
• —Paper 📝: PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning

Uses

This model is intended for mathematical reasoning tasks. It leverages prompt augmentation to generate reasoning traces under diverse templates, increasing rollout diversity and stability during RL training.

Results

<p align="center"> <img src="https://raw.githubusercontent.com/wenquanlu/prompt-augmentation-GRPO/master/imgs/oldtableresult.png"> </p>

Citation

@misc{lu2026pragpopromptaugmentedpolicy,
      title={PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning}, 
      author={Wenquan Lu and Hai Huang and Enqi Liu and Randall Balestriero},
      journal={arXiv preprint arXiv:2602.03190},
      url={https://arxiv.org/abs/2602.03190},
      year={2026},
}