DataDecide

A suite of models, data, and evals over 25 corpora, 14 sizes, and 3 seeds to measure how accurately small experiments predict rankings at large scale.

Upvote

allenai/DataDecide-eval-results

Viewer • Updated Apr 16, 2025 • 1.41M • 302 • 7
allenai/DataDecide-eval-instances

Viewer • Updated Mar 10, 2025 • 1.17k • 163 • 2
allenai/DataDecide-data-recipes

Updated May 6, 2025 • 1.77k • 8
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-60M

76.4M • Updated Apr 8, 2025 • 286 • 1
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-90M

0.1B • Updated Apr 9, 2025 • 72
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-20M

28.8M • Updated Apr 9, 2025 • 66
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-4M

6.96M • Updated Apr 9, 2025 • 126
allenai/DataDecide-dclm-baseline-qc-fw-3p-20M

28.8M • Updated Apr 9, 2025 • 67
allenai/DataDecide-dclm-baseline-qc-fw-3p-4M

6.96M • Updated Apr 9, 2025 • 60
allenai/DataDecide-dclm-baseline-qc-fw-3p-90M

0.1B • Updated Apr 9, 2025 • 68
allenai/DataDecide-dclm-baseline-qc-fw-3p-60M

76.4M • Updated Apr 9, 2025 • 62
allenai/DataDecide-falcon-60M

76.4M • Updated Apr 9, 2025 • 68
allenai/DataDecide-falcon-90M

0.1B • Updated Apr 9, 2025 • 75
allenai/DataDecide-falcon-20M

28.8M • Updated Apr 9, 2025 • 71
allenai/DataDecide-falcon-4M

6.96M • Updated Apr 9, 2025 • 66
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-90M

0.1B • Updated Apr 9, 2025 • 70
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-20M

28.8M • Updated Apr 9, 2025 • 66
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-60M

76.4M • Updated Apr 9, 2025 • 65
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-4M

6.96M • Updated Apr 9, 2025 • 130
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-60M

76.4M • Updated Apr 9, 2025 • 74
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-4M

6.96M • Updated Apr 9, 2025 • 63
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-20M

28.8M • Updated Apr 9, 2025 • 71
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-90M

0.1B • Updated Apr 9, 2025 • 70
allenai/DataDecide-dolma1_7-90M

0.1B • Updated Apr 9, 2025 • 81 • 2
allenai/DataDecide-dolma1_7-20M

28.8M • Updated Apr 9, 2025 • 244
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-4M

6.96M • Updated Apr 9, 2025 • 119
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-90M

0.1B • Updated Apr 9, 2025 • 72
allenai/DataDecide-dolma1_7-60M

76.4M • Updated Apr 9, 2025 • 413
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-60M

76.4M • Updated Apr 9, 2025 • 66
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-20M

28.8M • Updated Apr 9, 2025 • 67
allenai/DataDecide-dolma1_7-4M

6.96M • Updated Apr 9, 2025 • 246
allenai/DataDecide-dclm-baseline-qc-20p-90M

0.1B • Updated Apr 9, 2025 • 72
allenai/DataDecide-dclm-baseline-qc-20p-20M

28.8M • Updated Apr 9, 2025 • 69
allenai/DataDecide-dclm-baseline-qc-20p-4M

6.96M • Updated Apr 9, 2025 • 68
allenai/DataDecide-dclm-baseline-qc-20p-60M

76.4M • Updated Apr 9, 2025 • 66
allenai/DataDecide-falcon-and-cc-qc-10p-4M

6.96M • Updated Apr 9, 2025 • 65
allenai/DataDecide-falcon-and-cc-qc-10p-60M

76.4M • Updated Apr 9, 2025 • 68
allenai/DataDecide-falcon-and-cc-qc-10p-90M

0.1B • Updated Apr 9, 2025 • 72
allenai/DataDecide-falcon-and-cc-qc-10p-20M

28.8M • Updated Apr 9, 2025 • 73
allenai/DataDecide-dclm-baseline-qc-7p-fw3-90M

0.1B • Updated Apr 9, 2025 • 73
allenai/DataDecide-dclm-baseline-qc-7p-fw3-4M

6.96M • Updated Apr 9, 2025 • 60
allenai/DataDecide-dclm-baseline-qc-7p-fw3-20M

28.8M • Updated Apr 9, 2025 • 103
allenai/DataDecide-dclm-baseline-qc-7p-fw3-60M

76.4M • Updated Apr 9, 2025 • 68
allenai/DataDecide-dolma1_7-no-math-code-90M

0.1B • Updated Apr 9, 2025 • 79
allenai/DataDecide-dolma1_7-no-math-code-60M

76.4M • Updated Apr 9, 2025 • 69
allenai/DataDecide-dolma1_7-no-math-code-20M

28.8M • Updated Apr 9, 2025 • 70
allenai/DataDecide-dolma1_7-no-math-code-4M

6.96M • Updated Apr 9, 2025 • 69
allenai/DataDecide-dolma1_7-no-flan-20M

28.8M • Updated Apr 9, 2025 • 73
allenai/DataDecide-dolma1_7-no-flan-60M

76.4M • Updated Apr 9, 2025 • 64
allenai/DataDecide-dolma1_7-no-flan-90M

0.1B • Updated Apr 9, 2025 • 71 • 1
allenai/DataDecide-dolma1_7-no-flan-4M

6.96M • Updated Apr 9, 2025 • 123
allenai/DataDecide-falcon-and-cc-90M

0.1B • Updated Apr 9, 2025 • 70
allenai/DataDecide-falcon-and-cc-20M

28.8M • Updated Apr 9, 2025 • 191
allenai/DataDecide-falcon-and-cc-60M

76.4M • Updated Apr 9, 2025 • 66
allenai/DataDecide-falcon-and-cc-4M

6.96M • Updated Apr 9, 2025 • 121
allenai/DataDecide-falcon-and-cc-qc-20p-90M

0.1B • Updated Apr 9, 2025 • 72
allenai/DataDecide-falcon-and-cc-qc-20p-60M

76.4M • Updated Apr 9, 2025 • 65
allenai/DataDecide-falcon-and-cc-qc-20p-20M

28.8M • Updated Apr 9, 2025 • 188
allenai/DataDecide-falcon-and-cc-qc-20p-4M

6.96M • Updated Apr 9, 2025 • 61
allenai/DataDecide-dclm-baseline-qc-10p-4M

6.96M • Updated Apr 9, 2025 • 64
allenai/DataDecide-dclm-baseline-qc-10p-60M

76.4M • Updated Apr 9, 2025 • 72
allenai/DataDecide-dclm-baseline-qc-10p-90M

0.1B • Updated Apr 9, 2025 • 76
allenai/DataDecide-dclm-baseline-qc-10p-20M

28.8M • Updated Apr 9, 2025 • 191
allenai/DataDecide-dolma1_7-no-reddit-60M

76.4M • Updated Apr 9, 2025 • 68
allenai/DataDecide-dolma1_7-no-reddit-90M

0.1B • Updated Apr 9, 2025 • 74
allenai/DataDecide-dolma1_7-no-reddit-20M

28.8M • Updated Apr 9, 2025 • 68
allenai/DataDecide-dolma1_7-no-reddit-4M

6.96M • Updated Apr 9, 2025 • 65
allenai/DataDecide-dclm-baseline-qc-fw-10p-60M

76.4M • Updated Apr 9, 2025 • 62
allenai/DataDecide-dclm-baseline-qc-fw-10p-90M

0.1B • Updated Apr 9, 2025 • 74
allenai/DataDecide-dclm-baseline-qc-fw-10p-20M

28.8M • Updated Apr 9, 2025 • 185
allenai/DataDecide-dclm-baseline-qc-fw-10p-4M

6.96M • Updated Apr 9, 2025 • 122
allenai/DataDecide-dclm-baseline-90M

0.1B • Updated Apr 9, 2025 • 83
allenai/DataDecide-dclm-baseline-60M

76.4M • Updated Apr 9, 2025 • 74
allenai/DataDecide-dclm-baseline-20M

28.8M • Updated Apr 9, 2025 • 80
allenai/DataDecide-dclm-baseline-4M

6.96M • Updated Apr 9, 2025 • 129
allenai/DataDecide-dolma1_6plus-60M

76.4M • Updated Apr 9, 2025 • 64
allenai/DataDecide-dolma1_6plus-90M

0.1B • Updated Apr 9, 2025 • 70
allenai/DataDecide-dolma1_6plus-20M

28.8M • Updated Apr 9, 2025 • 181
allenai/DataDecide-dolma1_6plus-4M

6.96M • Updated Apr 9, 2025 • 118
allenai/DataDecide-fineweb-edu-20M

28.8M • Updated Apr 9, 2025 • 72
allenai/DataDecide-fineweb-edu-90M

0.1B • Updated Apr 9, 2025 • 300
allenai/DataDecide-fineweb-edu-4M

6.96M • Updated Apr 9, 2025 • 117
allenai/DataDecide-fineweb-edu-60M

76.4M • Updated Apr 9, 2025 • 288
allenai/DataDecide-falcon-and-cc-qc-orig-10p-90M

0.1B • Updated Apr 9, 2025 • 292
allenai/DataDecide-falcon-and-cc-qc-orig-10p-60M

76.4M • Updated Apr 9, 2025 • 65
allenai/DataDecide-falcon-and-cc-qc-orig-10p-4M

6.96M • Updated Apr 9, 2025 • 122 • 1
allenai/DataDecide-falcon-and-cc-qc-orig-10p-20M

28.8M • Updated Apr 9, 2025 • 193
allenai/DataDecide-dolma1_7-no-code-60M

76.4M • Updated Apr 9, 2025 • 295
allenai/DataDecide-dolma1_7-no-code-90M

0.1B • Updated Apr 9, 2025 • 75
allenai/DataDecide-dolma1_7-no-code-20M

28.8M • Updated Apr 9, 2025 • 192
allenai/DataDecide-dolma1_7-no-code-4M

6.96M • Updated Apr 9, 2025 • 125
allenai/DataDecide-c4-20M

28.8M • Updated Apr 9, 2025 • 1.51k
allenai/DataDecide-c4-60M

76.4M • Updated Apr 9, 2025 • 69
allenai/DataDecide-c4-90M

0.1B • Updated Apr 9, 2025 • 81
allenai/DataDecide-c4-4M

6.96M • Updated Apr 9, 2025 • 126
allenai/DataDecide-dclm-baseline-qc-7p-fw2-90M

0.1B • Updated Apr 9, 2025 • 70
allenai/DataDecide-dclm-baseline-qc-7p-fw2-20M

28.8M • Updated Apr 9, 2025 • 128
allenai/DataDecide-dclm-baseline-qc-7p-fw2-60M

76.4M • Updated Apr 9, 2025 • 77
allenai/DataDecide-dclm-baseline-qc-7p-fw2-4M

6.96M • Updated Apr 9, 2025 • 118
allenai/DataDecide-fineweb-pro-60M

76.4M • Updated Apr 9, 2025 • 286
allenai/DataDecide-fineweb-pro-90M

0.1B • Updated Apr 9, 2025 • 73
allenai/DataDecide-fineweb-pro-20M

28.8M • Updated Apr 9, 2025 • 191
allenai/DataDecide-fineweb-pro-4M

6.96M • Updated Apr 9, 2025 • 120
allenai/DataDecide-dolma1_7-no-code-150M

0.2B • Updated Apr 9, 2025 • 97
allenai/DataDecide-dclm-baseline-qc-fw-3p-150M

0.2B • Updated Apr 9, 2025 • 73
allenai/DataDecide-falcon-and-cc-qc-10p-150M

0.2B • Updated Apr 9, 2025 • 68
allenai/DataDecide-c4-150M

0.2B • Updated Apr 9, 2025 • 121
allenai/DataDecide-dclm-baseline-qc-7p-fw3-150M

0.2B • Updated Apr 9, 2025 • 76
allenai/DataDecide-fineweb-edu-150M

0.2B • Updated Apr 9, 2025 • 77
allenai/DataDecide-dolma1_7-150M

0.2B • Updated Apr 9, 2025 • 2.44k
allenai/DataDecide-dolma1_6plus-150M

0.2B • Updated Apr 9, 2025 • 71
allenai/DataDecide-dclm-baseline-qc-7p-fw2-150M

0.2B • Updated Apr 9, 2025 • 82
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-150M

0.2B • Updated Apr 9, 2025 • 74
allenai/DataDecide-dclm-baseline-150M

0.2B • Updated Apr 9, 2025 • 113
allenai/DataDecide-falcon-and-cc-qc-20p-150M

0.2B • Updated Apr 9, 2025 • 70 • 1
allenai/DataDecide-fineweb-pro-150M

0.2B • Updated Apr 9, 2025 • 71
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-150M

0.2B • Updated Apr 9, 2025 • 70
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-150M

0.2B • Updated Apr 9, 2025 • 66
allenai/DataDecide-falcon-150M

0.2B • Updated Apr 9, 2025 • 73
allenai/DataDecide-falcon-and-cc-150M

0.2B • Updated Apr 9, 2025 • 72
allenai/DataDecide-dolma1_7-no-math-code-150M

0.2B • Updated Apr 9, 2025 • 95
allenai/DataDecide-dolma1_7-no-reddit-150M

0.2B • Updated Apr 9, 2025 • 73
allenai/DataDecide-dolma1_7-no-flan-150M

0.2B • Updated Apr 9, 2025 • 72
allenai/DataDecide-falcon-and-cc-qc-orig-10p-150M

0.2B • Updated Apr 9, 2025 • 70
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-150M

0.2B • Updated Apr 9, 2025 • 71
allenai/DataDecide-dclm-baseline-qc-fw-10p-150M

0.2B • Updated Apr 9, 2025 • 360
allenai/DataDecide-dolma1_7-1B

1B • Updated Apr 9, 2025 • 1.11k
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-1B

1B • Updated Apr 9, 2025 • 95
allenai/DataDecide-falcon-and-cc-qc-10p-1B

1B • Updated Apr 9, 2025 • 97
allenai/DataDecide-falcon-1B

1B • Updated Apr 9, 2025 • 97
allenai/DataDecide-dclm-baseline-qc-7p-fw3-1B

1B • Updated Apr 9, 2025 • 98
allenai/DataDecide-dclm-baseline-qc-7p-fw2-1B

1B • Updated Apr 9, 2025 • 99
allenai/DataDecide-dclm-baseline-1B

1B • Updated Apr 9, 2025 • 136
allenai/DataDecide-falcon-and-cc-1B

1B • Updated Apr 9, 2025 • 98
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-1B

1B • Updated Apr 9, 2025 • 403
allenai/DataDecide-falcon-and-cc-qc-orig-10p-1B

1B • Updated Apr 9, 2025 • 188
allenai/DataDecide-falcon-and-cc-qc-20p-1B

1B • Updated Apr 9, 2025 • 401
allenai/DataDecide-fineweb-edu-1B

1B • Updated Apr 9, 2025 • 412
allenai/DataDecide-dolma1_7-no-math-code-1B

1B • Updated Apr 9, 2025 • 176
allenai/DataDecide-fineweb-pro-1B

1B • Updated Apr 9, 2025 • 120
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-1B

1B • Updated Apr 9, 2025 • 98
allenai/DataDecide-dolma1_6plus-1B

1B • Updated Apr 9, 2025 • 101
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-1B

1B • Updated Apr 9, 2025 • 96
allenai/DataDecide-dolma1_7-no-code-1B

1B • Updated Apr 9, 2025 • 191
allenai/DataDecide-dolma1_7-no-flan-1B

1B • Updated Apr 9, 2025 • 127
allenai/DataDecide-dolma1_7-no-reddit-1B

1B • Updated Apr 9, 2025 • 94 • 1
allenai/DataDecide-c4-1B

1B • Updated Apr 9, 2025 • 147
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-750M

0.8B • Updated Apr 9, 2025 • 67
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-750M

0.8B • Updated Apr 9, 2025 • 65
allenai/DataDecide-fineweb-edu-750M

0.8B • Updated Apr 9, 2025 • 70
allenai/DataDecide-dolma1_7-no-flan-750M

0.8B • Updated Apr 9, 2025 • 61
allenai/DataDecide-falcon-and-cc-qc-10p-750M

0.8B • Updated Apr 9, 2025 • 276
allenai/DataDecide-fineweb-pro-750M

0.8B • Updated Apr 9, 2025 • 65
allenai/DataDecide-dclm-baseline-750M

0.8B • Updated Apr 9, 2025 • 67
allenai/DataDecide-dclm-baseline-qc-7p-fw2-750M

0.8B • Updated Apr 9, 2025 • 68 • 1
allenai/DataDecide-dolma1_7-750M

0.8B • Updated Apr 9, 2025 • 67
allenai/DataDecide-dclm-baseline-qc-fw-3p-750M

0.8B • Updated Apr 9, 2025 • 61
allenai/DataDecide-falcon-and-cc-qc-20p-750M

0.8B • Updated Apr 9, 2025 • 62
allenai/DataDecide-falcon-and-cc-qc-orig-10p-750M

0.8B • Updated Apr 9, 2025 • 61
allenai/DataDecide-dclm-baseline-qc-7p-fw3-750M

0.8B • Updated Apr 9, 2025 • 67
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-750M

0.8B • Updated Apr 9, 2025 • 65
allenai/DataDecide-dolma1_7-no-code-750M

0.8B • Updated Apr 9, 2025 • 68
allenai/DataDecide-falcon-750M

0.8B • Updated Apr 9, 2025 • 69
allenai/DataDecide-dolma1_7-no-math-code-750M

0.8B • Updated Apr 9, 2025 • 66 • 1
allenai/DataDecide-c4-750M

0.8B • Updated Apr 9, 2025 • 60 • 1
allenai/DataDecide-dolma1_6plus-750M

0.8B • Updated Apr 9, 2025 • 61
allenai/DataDecide-dolma1_7-no-reddit-750M

0.8B • Updated Apr 9, 2025 • 61
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-750M

0.8B • Updated Apr 9, 2025 • 60
allenai/DataDecide-falcon-and-cc-750M

0.8B • Updated Apr 9, 2025 • 64
allenai/DataDecide-dclm-baseline-qc-fw-10p-750M

0.8B • Updated Apr 9, 2025 • 64
allenai/DataDecide-dclm-baseline-qc-20p-300M

0.4B • Updated Apr 9, 2025 • 66
allenai/DataDecide-dclm-baseline-qc-20p-530M

0.6B • Updated Apr 9, 2025 • 73
allenai/DataDecide-dclm-baseline-qc-20p-1B

1B • Updated Apr 9, 2025 • 397
allenai/DataDecide-dclm-baseline-qc-20p-150M

0.2B • Updated Apr 9, 2025 • 72
allenai/DataDecide-dclm-baseline-qc-20p-750M

0.8B • Updated Apr 9, 2025 • 373
allenai/DataDecide-dclm-baseline-qc-fw-3p-1B

1B • Updated Apr 9, 2025 • 395
allenai/DataDecide-dclm-baseline-qc-10p-150M

0.2B • Updated Apr 9, 2025 • 390
allenai/DataDecide-dclm-baseline-qc-10p-750M

0.8B • Updated Apr 9, 2025 • 67
allenai/DataDecide-dclm-baseline-qc-10p-530M

0.6B • Updated Apr 9, 2025 • 67
allenai/DataDecide-dclm-baseline-qc-10p-300M

0.4B • Updated Apr 9, 2025 • 70
allenai/DataDecide-dclm-baseline-qc-10p-1B

1B • Updated Apr 9, 2025 • 109
allenai/DataDecide-dclm-baseline-qc-fw-10p-1B

1B • Updated Apr 9, 2025 • 402
allenai/DataDecide-fineweb-pro-530M

0.6B • Updated Apr 9, 2025 • 61
allenai/DataDecide-fineweb-edu-530M

0.6B • Updated Apr 9, 2025 • 60
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-530M

0.6B • Updated Apr 9, 2025 • 68
allenai/DataDecide-falcon-and-cc-qc-10p-530M

0.6B • Updated Apr 9, 2025 • 62
allenai/DataDecide-dclm-baseline-qc-7p-fw3-530M

0.6B • Updated Apr 9, 2025 • 66
allenai/DataDecide-dolma1_7-no-reddit-530M

0.6B • Updated Apr 9, 2025 • 62
allenai/DataDecide-dolma1_7-530M

0.6B • Updated Apr 9, 2025 • 880
allenai/DataDecide-dolma1_6plus-530M

0.6B • Updated Apr 9, 2025 • 61
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-530M

0.6B • Updated Apr 9, 2025 • 60
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-530M

0.6B • Updated Apr 9, 2025 • 61
allenai/DataDecide-dolma1_7-no-flan-530M

0.6B • Updated Apr 9, 2025 • 62
allenai/DataDecide-falcon-and-cc-qc-20p-530M

0.6B • Updated Apr 9, 2025 • 61
allenai/DataDecide-falcon-and-cc-530M

0.6B • Updated Apr 9, 2025 • 64
allenai/DataDecide-dclm-baseline-530M

0.6B • Updated Apr 9, 2025 • 64
allenai/DataDecide-c4-530M

0.6B • Updated Apr 9, 2025 • 75
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-530M

0.6B • Updated Apr 9, 2025 • 62
allenai/DataDecide-falcon-530M

0.6B • Updated Apr 9, 2025 • 66
allenai/DataDecide-falcon-and-cc-qc-orig-10p-530M

0.6B • Updated Apr 9, 2025 • 61
allenai/DataDecide-dolma1_7-no-code-530M

0.6B • Updated Apr 9, 2025 • 63
allenai/DataDecide-dclm-baseline-qc-fw-3p-530M

0.6B • Updated Apr 9, 2025 • 61
allenai/DataDecide-dclm-baseline-qc-7p-fw2-530M

0.6B • Updated Apr 9, 2025 • 65
allenai/DataDecide-dolma1_7-no-math-code-530M

0.6B • Updated Apr 9, 2025 • 66
allenai/DataDecide-dclm-baseline-qc-7p-fw2-300M

0.4B • Updated Apr 9, 2025 • 69
allenai/DataDecide-dolma1_7-no-flan-300M

0.4B • Updated Apr 9, 2025 • 69
allenai/DataDecide-dolma1_7-no-math-code-300M

0.4B • Updated Apr 9, 2025 • 66
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-300M

0.4B • Updated Apr 9, 2025 • 63
allenai/DataDecide-falcon-and-cc-qc-orig-10p-300M

0.4B • Updated Apr 9, 2025 • 63
allenai/DataDecide-fineweb-edu-300M

0.4B • Updated Apr 9, 2025 • 66
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-300M

0.4B • Updated Apr 9, 2025 • 71
allenai/DataDecide-falcon-and-cc-300M

0.4B • Updated Apr 9, 2025 • 64
allenai/DataDecide-dclm-baseline-300M

0.4B • Updated Apr 9, 2025 • 70
allenai/DataDecide-falcon-and-cc-qc-10p-300M

0.4B • Updated Apr 9, 2025 • 65
allenai/DataDecide-falcon-and-cc-qc-20p-300M

0.4B • Updated Apr 9, 2025 • 62
allenai/DataDecide-dolma1_7-no-reddit-300M

0.4B • Updated Apr 9, 2025 • 65
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-300M

0.4B • Updated Apr 9, 2025 • 64
allenai/DataDecide-fineweb-pro-300M

0.4B • Updated Apr 9, 2025 • 65
allenai/DataDecide-dolma1_6plus-300M

0.4B • Updated Apr 9, 2025 • 59
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-300M

0.4B • Updated Apr 9, 2025 • 64
allenai/DataDecide-dolma1_7-no-code-300M

0.4B • Updated Apr 9, 2025 • 70
allenai/DataDecide-dolma1_7-300M

0.4B • Updated Apr 9, 2025 • 305
allenai/DataDecide-c4-300M

0.4B • Updated Apr 9, 2025 • 79
allenai/DataDecide-dclm-baseline-qc-fw-3p-300M

0.4B • Updated Apr 9, 2025 • 61
allenai/DataDecide-falcon-300M

0.4B • Updated Apr 9, 2025 • 66
allenai/DataDecide-dclm-baseline-qc-7p-fw3-300M

0.4B • Updated Apr 9, 2025 • 411
allenai/DataDecide-dclm-baseline-qc-fw-10p-530M

0.6B • Updated Apr 9, 2025 • 65
allenai/DataDecide-dclm-baseline-qc-fw-10p-300M

0.4B • Updated Apr 9, 2025 • 58
allenai/DataDecide-falcon-10M

17.1M • Updated Apr 9, 2025 • 198
allenai/DataDecide-dolma1_7-no-flan-10M

17.1M • Updated Apr 9, 2025 • 194
allenai/DataDecide-dolma1_6plus-10M

17.1M • Updated Apr 9, 2025 • 191
allenai/DataDecide-fineweb-edu-10M

17.1M • Updated Apr 9, 2025 • 197 • 1
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-10M

17.1M • Updated Apr 9, 2025 • 66
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-10M

17.1M • Updated Apr 9, 2025 • 192
allenai/DataDecide-dolma1_7-no-math-code-10M

17.1M • Updated Apr 9, 2025 • 187
allenai/DataDecide-fineweb-pro-10M

17.1M • Updated Apr 9, 2025 • 71
allenai/DataDecide-dolma1_7-no-reddit-10M

17.1M • Updated Apr 9, 2025 • 110
allenai/DataDecide-dclm-baseline-qc-10p-10M

17.1M • Updated Apr 9, 2025 • 69
allenai/DataDecide-dclm-baseline-qc-7p-fw2-10M

17.1M • Updated Apr 9, 2025 • 67
allenai/DataDecide-dolma1_7-no-code-10M

17.1M • Updated Apr 9, 2025 • 188
allenai/DataDecide-dclm-baseline-qc-7p-fw3-10M

17.1M • Updated Apr 9, 2025 • 66
allenai/DataDecide-c4-10M

17.1M • Updated Apr 9, 2025 • 68
allenai/DataDecide-falcon-and-cc-qc-orig-10p-10M

17.1M • Updated Apr 9, 2025 • 192
allenai/DataDecide-falcon-and-cc-qc-10p-10M

17.1M • Updated Apr 9, 2025 • 189
allenai/DataDecide-falcon-and-cc-10M

17.1M • Updated Apr 9, 2025 • 194
allenai/DataDecide-dclm-baseline-qc-fw-3p-10M

17.1M • Updated Apr 9, 2025 • 193
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-10M

17.1M • Updated Apr 9, 2025 • 186
allenai/DataDecide-dolma1_7-10M

17.1M • Updated Apr 9, 2025 • 198
allenai/DataDecide-falcon-and-cc-qc-20p-10M

17.1M • Updated Apr 9, 2025 • 67
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-10M

17.1M • Updated Apr 9, 2025 • 191
allenai/DataDecide-dclm-baseline-qc-fw-10p-10M

17.1M • Updated Apr 9, 2025 • 187
allenai/DataDecide-dclm-baseline-qc-20p-10M

17.1M • Updated Apr 9, 2025 • 195
allenai/DataDecide-dclm-baseline-10M

17.1M • Updated Apr 9, 2025 • 198
allenai/DataDecide-dolma1_6plus-8M

15M • Updated Apr 9, 2025 • 174
allenai/DataDecide-dolma1_7-no-code-8M

15M • Updated Apr 9, 2025 • 66
allenai/DataDecide-dolma1_7-8M

15M • Updated Apr 9, 2025 • 70
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-8M

15M • Updated Apr 9, 2025 • 62
allenai/DataDecide-dclm-baseline-qc-10p-8M

15M • Updated Apr 9, 2025 • 169
allenai/DataDecide-fineweb-edu-8M

15M • Updated Apr 9, 2025 • 176
allenai/DataDecide-dolma1_7-no-reddit-8M

15M • Updated Apr 9, 2025 • 173
allenai/DataDecide-dclm-baseline-qc-fw-3p-8M

15M • Updated Apr 9, 2025 • 173
allenai/DataDecide-falcon-and-cc-qc-10p-8M

15M • Updated Apr 9, 2025 • 175
allenai/DataDecide-falcon-and-cc-8M

15M • Updated Apr 9, 2025 • 120
allenai/DataDecide-falcon-and-cc-qc-orig-10p-8M

15M • Updated Apr 9, 2025 • 182
allenai/DataDecide-dclm-baseline-qc-fw-10p-8M

15M • Updated Apr 9, 2025 • 171
allenai/DataDecide-falcon-8M

15M • Updated Apr 9, 2025 • 173
allenai/DataDecide-falcon-and-cc-qc-20p-8M

15M • Updated Apr 9, 2025 • 174
allenai/DataDecide-dolma1_7-no-math-code-8M

15M • Updated Apr 9, 2025 • 68
allenai/DataDecide-dclm-baseline-8M

15M • Updated Apr 9, 2025 • 67
allenai/DataDecide-fineweb-pro-8M

15M • Updated Apr 9, 2025 • 170 • 1
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-8M

15M • Updated Apr 9, 2025 • 166
allenai/DataDecide-dclm-baseline-qc-7p-fw2-8M

15M • Updated Apr 9, 2025 • 172
allenai/DataDecide-c4-8M

15M • Updated Apr 9, 2025 • 176
allenai/DataDecide-dolma1_7-no-flan-8M

15M • Updated Apr 9, 2025 • 67
allenai/DataDecide-dclm-baseline-qc-20p-8M

15M • Updated Apr 9, 2025 • 175
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-8M

15M • Updated Apr 9, 2025 • 173
allenai/DataDecide-dclm-baseline-qc-7p-fw3-8M

15M • Updated Apr 9, 2025 • 61
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-8M

15M • Updated Apr 9, 2025 • 62
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-14M

24M • Updated Apr 9, 2025 • 60
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-14M

24M • Updated Apr 9, 2025 • 231
allenai/DataDecide-dolma1_7-no-flan-14M

24M • Updated Apr 9, 2025 • 63
allenai/DataDecide-c4-14M

24M • Updated Apr 9, 2025 • 71
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-14M

24M • Updated Apr 9, 2025 • 233
allenai/DataDecide-falcon-and-cc-qc-10p-14M

24M • Updated Apr 9, 2025 • 62
allenai/DataDecide-dolma1_6plus-14M

24M • Updated Apr 9, 2025 • 235
allenai/DataDecide-dclm-baseline-qc-10p-14M

24M • Updated Apr 9, 2025 • 237
allenai/DataDecide-dolma1_7-14M

24M • Updated Apr 9, 2025 • 233
allenai/DataDecide-falcon-and-cc-qc-20p-14M

24M • Updated Apr 9, 2025 • 65
allenai/DataDecide-dolma1_7-no-code-14M

24M • Updated Apr 9, 2025 • 64
allenai/DataDecide-dolma1_7-no-reddit-14M

24M • Updated Apr 9, 2025 • 60
allenai/DataDecide-dclm-baseline-14M

24M • Updated Apr 9, 2025 • 67
allenai/DataDecide-dclm-baseline-qc-7p-fw2-14M

24M • Updated Apr 9, 2025 • 68
allenai/DataDecide-falcon-14M

24M • Updated Apr 9, 2025 • 241
allenai/DataDecide-falcon-and-cc-14M

24M • Updated Apr 9, 2025 • 64
allenai/DataDecide-dolma1_7-no-math-code-14M

24M • Updated Apr 9, 2025 • 238
allenai/DataDecide-fineweb-pro-14M

24M • Updated Apr 9, 2025 • 61
allenai/DataDecide-dclm-baseline-qc-20p-14M

24M • Updated Apr 9, 2025 • 64
allenai/DataDecide-dclm-baseline-qc-fw-10p-14M

24M • Updated Apr 9, 2025 • 228
allenai/DataDecide-dclm-baseline-qc-fw-3p-14M

24M • Updated Apr 9, 2025 • 62
allenai/DataDecide-falcon-and-cc-qc-orig-10p-14M

24M • Updated Apr 9, 2025 • 61
allenai/DataDecide-fineweb-edu-14M

24M • Updated Apr 9, 2025 • 63 • 2
allenai/DataDecide-dclm-baseline-qc-7p-fw3-14M

24M • Updated Apr 9, 2025 • 65
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-14M

24M • Updated Apr 9, 2025 • 65
allenai/DataDecide-falcon-16M

26.5M • Updated Apr 9, 2025 • 248
allenai/DataDecide-dclm-baseline-16M

26.5M • Updated Apr 9, 2025 • 249
allenai/DataDecide-dolma1_7-16M

26.5M • Updated Apr 9, 2025 • 256
allenai/DataDecide-dolma1_7-no-flan-16M

26.5M • Updated Apr 9, 2025 • 63
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-16M

26.5M • Updated Apr 9, 2025 • 249
allenai/DataDecide-c4-16M

26.5M • Updated Apr 9, 2025 • 254 • 1
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-16M

26.5M • Updated Apr 9, 2025 • 60
allenai/DataDecide-dolma1_7-no-math-code-16M

26.5M • Updated Apr 9, 2025 • 261
allenai/DataDecide-dclm-baseline-qc-10p-16M

26.5M • Updated Apr 9, 2025 • 254
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-16M

26.5M • Updated Apr 9, 2025 • 250
allenai/DataDecide-dclm-baseline-qc-20p-16M

26.5M • Updated Apr 9, 2025 • 250
allenai/DataDecide-dclm-baseline-qc-7p-fw3-16M

26.5M • Updated Apr 9, 2025 • 249
allenai/DataDecide-fineweb-edu-16M

26.5M • Updated Apr 9, 2025 • 62
allenai/DataDecide-dclm-baseline-qc-fw-10p-16M

26.5M • Updated Apr 9, 2025 • 246
allenai/DataDecide-falcon-and-cc-qc-10p-16M

26.5M • Updated Apr 9, 2025 • 255
allenai/DataDecide-dolma1_7-no-reddit-16M

26.5M • Updated Apr 9, 2025 • 61
allenai/DataDecide-falcon-and-cc-qc-orig-10p-16M

26.5M • Updated Apr 9, 2025 • 64
allenai/DataDecide-falcon-and-cc-qc-20p-16M

26.5M • Updated Apr 9, 2025 • 257
allenai/DataDecide-dolma1_7-no-code-16M

26.5M • Updated Apr 9, 2025 • 252
allenai/DataDecide-falcon-and-cc-16M

26.5M • Updated Apr 9, 2025 • 255
allenai/DataDecide-dclm-baseline-qc-7p-fw2-16M

26.5M • Updated Apr 9, 2025 • 61 • 1
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-16M

26.5M • Updated Apr 9, 2025 • 254
allenai/DataDecide-fineweb-pro-16M

26.5M • Updated Apr 9, 2025 • 249
allenai/DataDecide-dclm-baseline-qc-fw-3p-16M

26.5M • Updated Apr 9, 2025 • 64
allenai/DataDecide-dolma1_6plus-16M

26.5M • Updated Apr 9, 2025 • 65
allenai/DataDecide-falcon-6M

10.8M • Updated Apr 9, 2025 • 149
allenai/DataDecide-dclm-baseline-qc-7p-fw3-6M

10.8M • Updated Apr 9, 2025 • 144
allenai/DataDecide-dclm-baseline-25p-dolma1.7-75p-6M

10.8M • Updated Apr 9, 2025 • 147
allenai/DataDecide-dclm-baseline-qc-7p-fw2-6M

10.8M • Updated Apr 9, 2025 • 145
allenai/DataDecide-falcon-and-cc-6M

10.8M • Updated Apr 9, 2025 • 138
allenai/DataDecide-falcon-and-cc-qc-20p-6M

10.8M • Updated Apr 9, 2025 • 145
allenai/DataDecide-dclm-baseline-75p-dolma1.7-25p-6M

10.8M • Updated Apr 9, 2025 • 147 • 1
allenai/DataDecide-dclm-baseline-qc-fw-10p-6M

10.8M • Updated Apr 9, 2025 • 144
allenai/DataDecide-dclm-baseline-qc-fw-3p-6M

10.8M • Updated Apr 9, 2025 • 70
allenai/DataDecide-dolma1_7-no-code-6M

10.8M • Updated Apr 9, 2025 • 145
allenai/DataDecide-falcon-and-cc-qc-10p-6M

10.8M • Updated Apr 9, 2025 • 144
allenai/DataDecide-falcon-and-cc-qc-orig-10p-6M

10.8M • Updated Apr 9, 2025 • 144
allenai/DataDecide-fineweb-pro-6M

10.8M • Updated Apr 9, 2025 • 147
allenai/DataDecide-dclm-baseline-qc-10p-6M

10.8M • Updated Apr 9, 2025 • 150
allenai/DataDecide-dolma1_7-6M

10.8M • Updated Apr 9, 2025 • 149
allenai/DataDecide-dolma1_7-no-math-code-6M

10.8M • Updated Apr 9, 2025 • 149
allenai/DataDecide-dolma1_7-no-flan-6M

10.8M • Updated Apr 9, 2025 • 148
allenai/DataDecide-dclm-baseline-qc-20p-6M

10.8M • Updated Apr 9, 2025 • 145
allenai/DataDecide-falcon-and-cc-qc-tulu-10p-6M

10.8M • Updated Apr 9, 2025 • 145
allenai/DataDecide-dclm-baseline-6M

10.8M • Updated Apr 9, 2025 • 153
allenai/DataDecide-dclm-baseline-50p-dolma1.7-50p-6M

10.8M • Updated Apr 9, 2025 • 144
allenai/DataDecide-fineweb-edu-6M

10.8M • Updated Apr 9, 2025 • 145
allenai/DataDecide-dolma1_6plus-6M

10.8M • Updated Apr 9, 2025 • 144
allenai/DataDecide-c4-6M

10.8M • Updated Apr 9, 2025 • 155 • 2
allenai/DataDecide-dolma1_7-no-reddit-6M

10.8M • Updated Apr 9, 2025 • 144
DataDecide: How to Predict Best Pretraining Data with Small Experiments

Paper • 2504.11393 • Published Apr 15, 2025 • 20

Upvote

Collection guide
Browse collections