language:en license:mit size_categories:n<1K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
dataset_info:
  features:
  - name: prompt
    dtype: string
  - name: unsafe_options
    sequence: string
  - name: safe_options
    sequence: string
  splits:
  - name: train
    num_bytes: 68795
    num_examples: 367
  download_size: 43031
  dataset_size: 68795
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
license: mit
language:
- en
---

# Dataset Card for SafeText

Paper: [SafeText: A Benchmark for Exploring Physical Safety in Language Models](https://aclanthology.org/2022.emnlp-main.154)

Data: [SafeText Dataset](https://github.com/sharonlevy/SafeText/blob/main/SafeText.json)

## About

This repository contains the dataset used in the paper **SafeText: A Benchmark for Exploring Physical Safety in Language Models**, to appear at EMNLP 2022. SafeText consists of scenarios and advice pairs designed to explore physical safety considerations in language models. Each scenario includes 2-3 safe pieces of advice and 1-2 unsafe pieces of advice. For more details, please refer to the [paper](https://aclanthology.org/2022.emnlp-main.154).

## License

- Licensed under [MIT License](https://opensource.org/licenses/MIT)

## Citation

When using this dataset, please cite the paper:

```
@inproceedings{levy-etal-2022-safetext,
    title = "{S}afe{T}ext: A Benchmark for Exploring Physical Safety in Language Models",
    author = "Levy, Sharon  and
      Allaway, Emily  and
      Subbiah, Melanie  and
      Chilton, Lydia  and
      Patton, Desmond  and
      McKeown, Kathleen  and
      Wang, William Yang",
    booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing",
    month = dec,
    year = "2022",
    address = "Abu Dhabi, United Arab Emirates",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.emnlp-main.154",
    pages = "2407--2421",
}
```