size_categories:1K<n<10K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars arxiv:2410.14872 region:us
---
dataset_info:
  features:
  - name: question_id
    dtype: string
  - name: prompt
    dtype: string
  - name: response_1
    dtype: string
  - name: response_2
    dtype: string
  - name: winner
    dtype: string
  splits:
  - name: test
    num_bytes: 1903286
    num_examples: 1000
  download_size: 1085469
  dataset_size: 1903286
configs:
- config_name: default
  data_files:
  - split: test
    path: data/test-*
---

# Overview

This is just a debug set for Preference Proxy Evaluations.

The prompts are sampled from [lmsys/chatbot_arena_conversations](https://huggingface.co/datasets/lmsys/chatbot_arena_conversations).

This dataset is meant for benchmarking and evaluation, not for training.

[Paper](https://arxiv.org/abs/2410.14872)

[Code](https://github.com/lmarena/PPE)

# License

User prompts are licensed under CC BY 4.0, and model outputs are governed by the terms of use set by the respective model providers.
