language:cs size_categories:10K<n<100K format:json modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
language:
- cs
---
## Introduction
This is a validation set split off from the historical dataset included in [BUT-LCC](https://huggingface.co/datasets/BUT-FIT/BUT-LCC) corpus. 
Furthermore, to avoid direct contamination from BUT-LCC, this set is filtered against the historical dataset from BUT-LCC by our fuzzy deduplication pipeline.

## Legal Information & Data Origin
This dataset consists of OCR'd documents since 1850, publicly available from the [Czech Digital Library](https://www.digitalniknihovna.cz/). We use [PeroOCR](https://pero-ocr.fit.vutbr.cz/) for optical character recognition (OCR). CZLC members do not own the distributed documents.

## Authors & Contact
- Karel Beneš & Martin Kišš (collection and OCR)
- Jan Doležal (fuzzy deduplication)
- Martin Fajčík (data split off, task management)
- Michal Hradiš (PERO Team Lead)

Correspondence to `martin.fajcik@vut.cz`