task_categories:image-to-text task_categories:text-to-image language:en license:mit size_categories:1K<n<10K format:json modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
license: mit
task_categories:
- image-to-text
- text-to-image
language:
- en
pretty_name: simons ARC (abstraction & reasoning corpus) solve probe-color version 10
size_categories:
- 1K<n<10K
configs:
- config_name: default
  data_files:
  - split: train
    path: data.jsonl
---

# Version 1

ARC-AGI Tasks where the job is to probe-colors in different directions.

example count: 3-4.

test count: 1-2.

image size: 3-4.

# Version 2

image size: 3-6.

# Version 3

example image size: 3-8.

test image size: 1-12. Out of distribution data.

# Version 4

example image size: 3-9.

test image size: 1-14. Out of distribution data.

This was too hard for the model to make sense of.

# Version 5

Only enabled: `TOP`, `BOTTOM` (since these are opposites). The others are disabled.

example image size: 3-9.

test image size: 1-14. Out of distribution data.

# Version 6

Only enabled: `LEFT`, `RIGHT` (since these are opposites). The others are disabled.

example image size: 3-9.

test image size: 1-14. Out of distribution data.

# Version 7

Only enabled: `TOPLEFT`, `BOTTOMRIGHT` (since these are opposites). The others are disabled.

example image size: 3-9.

test image size: 1-14. Out of distribution data.

# Version 8

Only enabled: `TOPRIGHT`, `BOTTOMLEFT` (since these are opposites). The others are disabled.

example image size: 3-9.

test image size: 1-14. Out of distribution data.

# Verison 9

Enabled all of the transformations.

Earlier predictions added to some of the rows.

# Version 10

Added fields: `arc_task`, `test_index`, `earlier_output`.