size_categories:n<1K format:parquet modality:tabular modality:text library:datasets library:pandas library:mlcroissant library:polars library:distilabel region:us synthetic distilabel rlaif
---
size_categories: n<1K
dataset_info:
  features:
  - name: question_id
    dtype: int64
  - name: question
    dtype: string
  - name: options
    sequence: string
  - name: answer
    dtype: string
  - name: answer_index
    dtype: int64
  - name: cot_content
    dtype: string
  - name: category
    dtype: string
  - name: src
    dtype: string
  - name: instruction
    dtype: string
  - name: output
    dtype: string
  - name: distilabel_metadata
    struct:
    - name: raw_input_text_generation_0
      list:
      - name: content
        dtype: string
      - name: role
        dtype: string
    - name: raw_output_text_generation_0
      dtype: string
  - name: model_name
    dtype: string
  splits:
  - name: train
    num_bytes: 388926
    num_examples: 70
  download_size: 233242
  dataset_size: 388926
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
tags:
- synthetic
- distilabel
- rlaif
---

<p align="left">
  <a href="https://github.com/argilla-io/distilabel">
    <img src="https://raw.githubusercontent.com/argilla-io/distilabel/main/docs/assets/distilabel-badge-light.png" alt="Built with Distilabel" width="200" height="32"/>
  </a>
</p>

# Dataset Card for mmmlu-pro-eval-llama

This dataset has been created with [distilabel](https://distilabel.argilla.io/).



## Dataset Summary

This dataset contains a `pipeline.yaml` which can be used to reproduce the pipeline that generated it in distilabel using the `distilabel` CLI:

```console
distilabel pipeline run --config "https://huggingface.co/datasets/dvilasuero/mmmlu-pro-eval-llama/raw/main/pipeline.yaml"
```

or explore the configuration:

```console
distilabel pipeline info --config "https://huggingface.co/datasets/dvilasuero/mmmlu-pro-eval-llama/raw/main/pipeline.yaml"
```

## Dataset structure

The examples have the following structure per configuration:


<details><summary> Configuration: default </summary><hr>

```json
{
    "answer": "A",
    "answer_index": 0,
    "category": "math",
    "cot_content": "A: Let\u0027s think step by step. A characteristic of a ring is R is $n$ if the statement $ka = 0$ for all $a\\in 2Z$ implies that $k$ is a multiple of $n$. Assume that $ka = 0$ for all $a\\in 2Z$ for some $k$. In particular $2k = 0$. Hence $k=0$ and $n=0$. The answer is (A).",
    "distilabel_metadata": {
        "raw_input_text_generation_0": [
            {
                "content": "Question:\nThe symmetric group $S_n$ has $\n\\factorial{n}$ elements, hence it is not true that $S_{10}$ has 10 elements.\nFind the characteristic of the ring 2Z.\nOptions:\nA. 0\nB. 30\nC. 3\nD. 10\nE. 12\nF. 50\nG. 2\nH. 100\nI. 20\nJ. 5\nAnswer: Let\u0027s think step by step.",
                "role": "user"
            }
        ],
        "raw_output_text_generation_0": "To solve this question, we need to determine the characteristic of the ring 2Z, which is the set of all even integers.\n\nThe characteristic of a ring is the smallest positive integer $n$ such that $n \\cdot a = 0$ for all $a$ in the ring. In other words, it is the smallest positive integer that annihilates every element of the ring.\n\nFor the ring 2Z, the operation is addition (not multiplication of integers). For any even integer $a \\in 2Z$, it is true that $2 \\cdot a = 0$ (since even + even = even, even + odd = odd, and odd + odd = even).\n\nTherefore, the characteristic of the ring 2Z is 2.\n\nSo, the correct answer is:\n\nG. 2"
    },
    "instruction": "Question:\nThe symmetric group $S_n$ has $\n\\factorial{n}$ elements, hence it is not true that $S_{10}$ has 10 elements.\nFind the characteristic of the ring 2Z.\nOptions:\nA. 0\nB. 30\nC. 3\nD. 10\nE. 12\nF. 50\nG. 2\nH. 100\nI. 20\nJ. 5\nAnswer: Let\u0027s think step by step.",
    "model_name": "meta-llama/Meta-Llama-3.1-8B-Instruct",
    "options": [
        "0",
        "30",
        "3",
        "10",
        "12",
        "50",
        "2",
        "100",
        "20",
        "5"
    ],
    "output": "To solve this question, we need to determine the characteristic of the ring 2Z, which is the set of all even integers.\n\nThe characteristic of a ring is the smallest positive integer $n$ such that $n \\cdot a = 0$ for all $a$ in the ring. In other words, it is the smallest positive integer that annihilates every element of the ring.\n\nFor the ring 2Z, the operation is addition (not multiplication of integers). For any even integer $a \\in 2Z$, it is true that $2 \\cdot a = 0$ (since even + even = even, even + odd = odd, and odd + odd = even).\n\nTherefore, the characteristic of the ring 2Z is 2.\n\nSo, the correct answer is:\n\nG. 2",
    "question": "The symmetric group $S_n$ has $\n\\factorial{n}$ elements, hence it is not true that $S_{10}$ has 10 elements.\nFind the characteristic of the ring 2Z.",
    "question_id": 0,
    "src": "cot_lib-abstract_algebra"
}
```

This subset can be loaded as:

```python
from datasets import load_dataset

ds = load_dataset("dvilasuero/mmmlu-pro-eval-llama", "default")
```

Or simply as it follows, since there's only one configuration and is named `default`: 

```python
from datasets import load_dataset

ds = load_dataset("dvilasuero/mmmlu-pro-eval-llama")
```


</details>




