task_categories:question-answering language:en license:mit region:us
---
language:
- en
license: mit
task_categories:
- question-answering
pretty_name: MMLU with Random Expert Identity 03
dataset_info:
  config_name: all
  features:
  - name: expert_identity
    dtype: string
  - name: question
    dtype: string
  - name: subject
    dtype: string
  - name: choices
    sequence: string
  - name: answer
    dtype:
      class_label:
        names:
          '0': A
          '1': B
          '2': C
          '3': D
  splits:
  - name: test
    num_bytes: 9487012
    num_examples: 14042
  - name: validation
    num_bytes: 1056514
    num_examples: 1531
  - name: dev
    num_bytes: 205898
    num_examples: 285
configs:
- config_name: all
  data_files:
  - split: test
    path: all/test_*
  - split: validation
    path: all/validation_*
  - split: dev
    path: all/dev_*
---
This dataset contains a copy of the `cais/mmlu` HF dataset but without the `auxiliary_train` split that takes a long time to generate again each time when loading multiple subsets of the dataset.

Please visit https://huggingface.co/datasets/cais/mmlu for more information on the MMLU dataset.