task_categories:text2text-generation language:en size_categories:n<1K region:us
---
task_categories:
- text2text-generation
language:
- en
pretty_name: orkl-clean-small
size_categories:
- n<1K
---
# ORKL-cleaned-small

This is a small excerpt of cleaned (pre-processed) reports from https://orkl.eu. 
Thanks to ORKL for providing these public datasets.
The problem with the .txt files from orkl is that (currently, June 2024 at least) the conversion from PDFs to .txt makes it hard to train on these texts.

We therefore converted the texts with [PyPDF2](https://pypi.org/project/PyPDF2/) and then cleaned it up via an LLM (removal of headers, footers, etc.)
Turns out that this dataset is very suitable for doing LoRA fine-tuning. 

