ddrg/math_formulas

Mathematical Formulas (MF)

Mathematical dataset containing formulas based on the AMPS Khan dataset and the ARQMath dataset V1.3. Based on the retrieved LaTeX formulas, more equivalent versions have been generated by applying randomized LaTeX printing with this SymPy fork using Math Mutator (MAMUT). The formulas are intended to be well applicable for MLM. For instance, a masking for a formula like (a+b)^2 = a^2 + 2ab + b^2 makes sense (e.g., (a+[MASK])^2 = a^2 + [MASK]ab + b[MASK]2 -> masked tokens are deducable by the context), in contrast, formulas such as f(x) = 3x+1 are not (e.g., [MASK](x) = 3x[MASK]1 -> [MASK] tokens are ambigious).

You can find more information in MAMUT: A Novel Framework for Modifying Mathematical Formulas for the Generation of Specialized Datasets for Language Model Training.

A similar dataset consisting of mathematical texts (i.e., texts containing LaTeX formulas between an inline math environment $...$) is https://huggingface.co/datasets/ddrg/math_text.

Citation

@article{
  drechsel2025mamut,
  title={{MAMUT}: A Novel Framework for Modifying Mathematical Formulas for the Generation of Specialized Datasets for Language Model Training},
  author={Jonathan Drechsel and Anja Reusch and Steffen Herbold},
  journal={Transactions on Machine Learning Research},
  issn={2835-8856},
  year={2025},
  url={https://openreview.net/forum?id=khODmRpQEx}
}