task_categories:text2text-generation language:en license:mit size_categories:100K<n<1M format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
license: mit
task_categories:
- text2text-generation
pretty_name: Wikipedia & Wikinews Revisions
language:
- en
size_categories:
- 100K<n<1M
---

This dataset contains 242,198 revision histories from __Wikipedia__, __WikiNews__, and __Arxiv__, capturing sentence-level changes across document versions. This enables the study of how documents evolve over time, particularly at the granular level of sentences.

The Wikipedia and WikiNews revision data was collected using [this](https://github.com/brotSchimmelt/better_crawl_saul) custom web crawler, while the Arxiv data was gathered using the crawler from the [IteraTeR project](https://github.com/vipulraheja/iterater).