size_categories:1K<n<10K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
dataset_info:
  features:
  - name: answer
    sequence: int64
  - name: question
    dtype: string
  - name: subject
    dtype: string
  - name: choices
    sequence: string
  splits:
  - name: train
    num_bytes: 1515147
    num_examples: 3362
  download_size: 850987
  dataset_size: 1515147
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
---

# Dataset Card

## Dataset Summary

This dataset is in the format of cais/mmlu but each question has more than 1 correct answers. This work uses gpt-4o-mini to generate data based on cais/mmlu. 
To improve the quality of data, this dataset has removed similar questions using semantic embedding and cosin similarity.

#### Language

English

## Data Structure

```json
{
        "question": "What are some benefits of consuming nuts as part of a healthy diet?",
        "choices": [
            "They can help reduce cholesterol levels",
            "They provide essential vitamins and minerals",
            "They are a good source of protein",
            "They are high in carbohydrates"
        ],
        "answer": [
            1,
            2,
            3
        ],
        "subject": ""
}

```

#### Data Fields

- `question`:  string
- `choices`: a list of strings, the number of choices can be larger than 4
- `answer`: a list of index (begins with 0)
- `subject`: always empty