size_categories:n<1K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars arxiv:1909.08593 region:us
---
dataset_info:
  features:
  - name: prompt
    dtype: string
  - name: chosen
    list:
    - name: content
      dtype: string
    - name: role
      dtype: string
  - name: rejected
    list:
    - name: content
      dtype: string
    - name: role
      dtype: string
  splits:
  - name: train
    num_bytes: 45237
    num_examples: 50
  - name: test
    num_bytes: 43372
    num_examples: 50
  download_size: 73158
  dataset_size: 88609
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
  - split: test
    path: data/test-*
---
# TRL's Preference Dataset: sentiment
The dataset comes from https://arxiv.org/abs/1909.08593, one of the earliest RLHF work from OpenAI.
We preprocess the dataset using our standard `prompt, chosen, rejected` format.
## Reproduce this dataset
1. Download the `sentiment.py` from the https://huggingface.co/datasets/vwxyzjn/sentiment-trl-style/tree/0.1.0.
2. Run `python examples/datasets/sentiment.py --debug --push_to_hub`
