license:apache-2.0 size_categories:10K<n<100K region:us
---
license: apache-2.0
size_categories:
- 10K<n<100K
---

# IHOP FLAN CoT ZeroShot

A recreation of the FLAN cot dataset for only zeroshot.

Because: the flan framework is nightmare to work with.  And the "conceptofmind" repos are missing the raw targets for eval as well as incorrectly labeling "opt"

I also add double line breaks between every "thought"/"step" in the response, to make it easier to eval with something like PRM outlined in "Let’s Verify Step by Step"

The templates are very similar and close enough that it shold not matter. 


## Citations

```
@article{longpre2023flan,
  title={The Flan Collection: Designing Data and Methods for Effective Instruction Tuning},
  author={Longpre, Shayne and Hou, Le and Vu, Tu and Webson, Albert and Chung, Hyung Won and Tay, Yi and Zhou, Denny and Le, Quoc V and Zoph, Barret and Wei, Jason and others},
  journal={arXiv preprint arXiv:2301.13688},
  year={2023}
}


@article{lightman2023lets,
      title={Let's Verify Step by Step}, 
      author={Lightman, Hunter and Kosaraju, Vineet and Burda, Yura and Edwards, Harri and Baker, Bowen and Lee, Teddy and Leike, Jan and Schulman, John and Sutskever, Ilya and Cobbe, Karl},
      journal={arXiv preprint arXiv:2305.20050},
      year={2023}
}
```


