AutoMathText-2.5

AutoMathText-2.5 is a foundational high-quality STEM training dataset released by Math-AI. It contains over 2 trillion tokens of deduplicated text spanning web content, mathematics, code, reasoning, and bilingual data.

Links

• Website: https://math-ai-org.github.io/AutoMathText-2.5
• Dataset: https://huggingface.co/datasets/math-ai/AutoMathText-2.5
• Technical paper: https://arxiv.org/abs/2402.07625
• License: AutoMathText Data Agreement for Model Training

Citation

@misc{automathtext_2_5,
  title={AutoMathText-2.5: A Foundational High-Quality STEM Training Dataset},
  author={Zhang, Yifan and Feng, Jichen and Math-AI, Team},
  year={2026},
  publisher={Hugging Face},
  url={https://huggingface.co/datasets/math-ai/AutoMathText-2.5},
}

@article{zhang2025autonomous,
  title   = {Autonomous Data Selection with Zero-shot Generative Classifiers for Mathematical Texts},
  author  = {Zhang, Yifan and Luo, Yifan and Yuan, Yang and Yao, Andrew C},
  journal = {Findings of the Association for Computational Linguistics: ACL 2025},
  year    = {2025}
}