NaturalProofs
NaturalProofs assembles mathematical knowledge in the form that mathematicians actually write it: theorem statements paired with their proofs. It contains around 32,000 theorem-and-proof pairs, 14,000 definitions, and 2,000 further pages such as axioms and corollaries.
The material is drawn from three sources: ProofWiki, a community encyclopaedia of mathematical proofs; the Stacks Project, a large collaborative reference in algebraic geometry; and a set of mathematics textbooks. The pages are linked by their references, so the data doubles as a small knowledge graph of how results depend on one another.
The processing code is released on GitHub under the MIT licence, but the underlying content keeps the licences of its original sources, which vary. Check the terms of each source before reusing the text commercially.
Related sources
AMPS
A dataset of informal mathematics introduced alongside the MATH benchmark. It includes more than 100,000 Khan Academy problems with step-by-step solutions in LaTeX and over 5 million problems generated with Mathematica scripts, totalling around 23 GB.
AutoMathText
Around 200 GB of mathematical text compiled from websites, arXiv, and GitHub, drawing on OpenWebMath, RedPajama, and AlgebraicStack. Every piece of content carries a score from 0 to 1 for relevance, quality, and educational value, labelled automatically by the Qwen-72B model.
Awesome AI Math Datasets
A community-curated list of open-source mathematics datasets for training and evaluating maths-capable language models. A useful index for finding newer additions in this space.
MegaMath
An open mathematics pretraining dataset curated from diverse, maths-focused sources, with over 300 billion tokens. Among the largest open maths corpora available.