language:en size_categories:1K<n<10K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
language:
- en
dataset_info:
  features:
  - name: chosen
    list:
    - name: content
      dtype: string
    - name: role
      dtype: string
  - name: rejected
    list:
    - name: content
      dtype: string
    - name: role
      dtype: string
  - name: prompt
    dtype: string
  splits:
  - name: train
    num_bytes: 1428026
    num_examples: 997
  - name: test
    num_bytes: 70580
    num_examples: 53
  download_size: 822702
  dataset_size: 1498606
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
  - split: test
    path: data/test-*
---
# TRL's Anthropic HH Dataset

We preprocess the dataset using our standard `prompt, chosen, rejected` format.


## Reproduce this dataset

1. Download the `anthropic_hh.py` from the https://huggingface.co/datasets/daidv1112/alignmem/tree/0.1.0.
2. Run `python examples/datasets/anthropic_hh.py --push_to_hub --hf_entity daidv1112`
