language:en license:mit region:us
---
license: mit
language:
- en
pretty_name: UK Government Policy Document Q&A
---
This is a dataset of UK government policy papers, scraped and designed for LLM fine tuning.

It comes in 2 parts:
1. Plain text UK government policy papers, scraped from the [Gov.uk Policy papers and consultations page](https://www.gov.uk/search/policy-papers-and-consultations?content_store_document_type%5B%5D=policy_papers&order=updated-newest). These are in results.json
2. A series of question and answer pairs on chunk of the above documents, generated using [llama_index.finetuning.generate_qa_embedding_pairs](https://docs.llamaindex.ai/en/stable/api_reference/) and OpenAI GPT3.5 Turbo.