Skip to content
RAG Repo

Wikimedia publishes full database dumps of Wikipedia, Wiktionary, Wikiquote, and the rest of its projects at dumps.wikimedia.org. You can download a single language edition or the lot, as raw wikitext or as parsed HTML.

For RAG, the English Wikipedia article text is a common starting point: it is broad, well structured, and cleanly licensed. The compressed English text dump is around 22 GB. Many pre-processed, article-per-record versions are also published on the Hugging Face Hub if you would rather skip the parsing step.

The text is licensed under Creative Commons Attribution-ShareAlike, which means you can reuse it as long as you credit Wikipedia and share any derived text under the same terms.

encyclopaediamultilingualgeneral-knowledgenonprofitbulk-download

Related sources