task_categories:text-classification task_ids:multi-label-classification region:us
---
task_categories:
- text-classification
task_ids:
- multi-label-classification
- toxic-comment-classification
---
<h1 align="center"> DATASET-NAME: Code Reasoning, Understanding, and Execution Evaluation </h1>

<p align="center">
    <a href="https://crux-eval.github.io/">🏠 Home Page</a> •
    <a href="https://github.com/facebookresearch/cruxeval">💻 GitHub Repository </a> •
    <a href="https://crux-eval.github.io/leaderboard.html">🏆 Leaderboard</a> •
    <a href="https://crux-eval.github.io/demo.html">🔎 Sample Explorer</a>
</p>

![image](https://github.com/facebookresearch/cruxeval/assets/7492257/4951c067-e6d0-489a-a445-37ff1c4ad1e4)

DATASET-NAME (**C**ode **R**easoning, **U**nderstanding, and e**X**ecution **Eval**uation) is a benchmark of 800 Python functions and input-output pairs. The benchmark consists of two tasks, CRUXEval-I (input prediction) and CRUXEval-O (output prediction). 

The benchmark was constructed as follows

## Dataset Description

- **Homepage:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **Repository:** https://github.com/
- **Paper:** https://arxiv.org/
- **Point of Contact:** [NAME](mailto:EMAIL)