license:cc-by-sa-4.0 arxiv:2404.04113 region:us
---
license: cc-by-sa-4.0
---

# BEAR Dataset


Dataset to evaluate common factual knowledge in language models. This dataset was created as part of the [paper "BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language Models"](https://arxiv.org/abs/2404.04113).


For more information visit the [LM Pub Quiz website](https://lm-pub-quiz.github.io/).

## Citation

When using the dataset or library, please cite the following paper:

```
@misc{wilandBEARUnifiedFramework2024,
  title = {{{BEAR}}: {{A Unified Framework}} for {{Evaluating Relational Knowledge}} in {{Causal}} and {{Masked Language Models}}},
  shorttitle = {{{BEAR}}},
  author = {Wiland, Jacek and Ploner, Max and Akbik, Alan},
  year = {2024},
  number = {arXiv:2404.04113},
  eprint = {2404.04113},
  publisher = {arXiv},
  url = {http://arxiv.org/abs/2404.04113},
}
```