Specialist corpora of mathematical and technical text, including proofs, problem sets, and worked solutions, for RAG systems that handle quantitative reasoning.
8sources
A dataset of informal mathematics introduced alongside the MATH benchmark. It includes more than 100,000 Khan Academy problems with step-by-step solutions in LaTeX and over 5 million problems generated with Mathematica scripts, totalling around 23 GB.
Around 200 GB of mathematical text compiled from websites, arXiv, and GitHub, drawing on OpenWebMath, RedPajama, and AlgebraicStack. Every piece of content carries a score from 0 to 1 for relevance, quality, and educational value, labelled automatically by the Qwen-72B model.
A community-curated list of open-source mathematics datasets for training and evaluating maths-capable language models. A useful index for finding newer additions in this space.
An open mathematics pretraining dataset curated from diverse, maths-focused sources, with over 300 billion tokens. Among the largest open maths corpora available.
A dataset of 32,000 theorem statements and proofs, 14,000 definitions, and 2,000 other pages including axioms and corollaries, drawn from ProofWiki, the Stacks Project, and mathematics textbooks.
A corpus of high-quality mathematical text extracted from the web. Filtered from over 200 billion HTML pages on Common Crawl down to 6.3 million documents totalling 14.7 billion tokens. Mostly mathematics, with substantial coverage of physics, computer science, and statistics.
A 55 billion token dataset of mathematical and scientific documents drawn from arXiv, OpenWebMath, and AlgebraicStack. The AlgebraicStack subset alone contributes 11 billion tokens covering numerical computing, computer algebra, and formal mathematics.
A curated collection of 2 million mathematical questions and answers sourced from various Stack Exchange sites. The question-and-answer structure maps naturally onto retrieval, which makes it well suited to Q&A-style RAG.