language:en license:apache-2.0 size_categories:n<1K format:json modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
language:
- en
license: apache-2.0
---
![image/png](https://huggingface.co/datasets/nbeerbower/cover-images/resolve/main/moderne-cover.png?download=true)

# Gutenberg-Moderne DPO

A DPO dataset meant to enhance the writing capabilities of LLMs using public domain books from [Project Gutenberg](https://gutenberg.org/).

Inspired by Jon Durbin's Gutenberg DPO dataset: [jondurbin/gutenberg-dpo-v0.1](https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1)

## Process

Various books were selected from Project Gutenberg for their "modern" (early 20th century) language and concise prose.

The process is nearly identical to [nbeerbower/gutenberg2-dpo](https://huggingface.co/datasets/nbeerbower/gutenberg2-dpo) except that the cleaning of the original text was improved and backported to the Gutenberg2 dataset.

gpt4o-mini was used to generate summaries and prompts.

[nbeerbower/Mahou-1.5-mistral-nemo-12B-lorablated](https://huggingface.co/nbeerbower/Mahou-1.5-mistral-nemo-12B-lorablated) was used to generate rejected values.

## Code

[gutenberg-tools](https://github.com/nbeerbower/gutenberg-tools) is MIT licensed on GitHub.

## Selected Works

- Free Air - Sinclair Lewis (1919)
- Jennie Gerhardt - Theodore Dreiser (1911)
- Manhattan Transfer - John Dos Passos (1925)
- The Mysterious Affair at Styles - Agatha Christie (1920)
- Sister Carrie - Theodore Dreiser (1900)
- The Financier - Theodore Dreiser (1912)
- The Job - Sinclair Lewis (1917)
- The Secret Adversary - Agatha Christie (1922)
- The Titan - Theodore Dreiser (1914)

## Disclaimer

This dataset is provided for free and as-is with absolutely no warranty. Some data may contain errors and be periodically modified.

You are free to modify and redistribute it as you wish.