Datasetpublic

NP235/open-web-math-pro

📚 Open-Web-Math-Pro ArXiv | Models | Code Open-Web-Math-Pro is refined from open-web-math using the ProX refining framework. It contains about 5B high quality math related tokens, ready for pre-training. License Open-Web-Math-Pro is based on open-web-math, which is made available under an ODC-By 1.0 license; users should also abide by the CommonCrawl ToU: https://commoncrawl.org/terms-of-use/. We do not alter the license of any of the underlying data.… See the full description on the dataset page: https://huggingface.co/datasets/NP235/open-web-math-pro.

sourceHugging Faceodc-byupdated 3mo agoView on Hugging Face

0likes113downloads

Dataset Card

📚 Open-Web-Math-Pro

ArXiv | Models | Code

Open-Web-Math-Pro is refined from open-web-math using the ProX refining framework. It contains about 5B high quality math related tokens, ready for pre-training.

License

Open-Web-Math-Pro is based on open-web-math, which is made available under an ODC-By 1.0 license; users should also abide by the CommonCrawl ToU: https://commoncrawl.org/terms-of-use/. We do not alter the license of any of the underlying data.

Citation

@article{zhou2024programming,
  title={Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale},
  author={Zhou, Fan and Wang, Zengzhi and Liu, Qian and Li, Junlong and Liu, Pengfei},
  journal={arXiv preprint arXiv:2409.17115},
  year={2024}
}