Create README.md

README.md

@@ -0,0 +1,62 @@
+---
+language:
+- en
+base_model:
+- Qwen/Qwen2.5-Math-7B
+tags:
+- One-Shot-CFT
+---
+# One-Shot-CFT: Unleashing the Reasoning Potential of Pre-trained LLMs by Critique Fine-Tuning on One Problem
+
+<p align="center">
+  <a href="https://github.com/TIGER-AI-Lab/One-Shot-CFT" target="_blank">💻 Code</a> |
+  <a href="https://arxiv.org/abs/" target="_blank">📄 Paper</a> |
+  <a href="https://huggingface.co/datasets/TIGER-Lab/One-Shot-CFT-Data" target="_blank">📊 Dataset</a> |
+  <a href="https://huggingface.co/collections/TIGER-Lab/one-shot-cft-683fbb4d2bcf698dbea8fb21" target="_blank">🤗 Model</a> |
+  <a href="https://tiger-ai-lab.github.io/One-Shot-CFT/" target="_blank">🌐 Project Page</a>
+</p>
+
+
+
+## 🧠 Overview
+
+One-Shot Critique Fine-Tuning (CFT) is a simple, robust, and compute-efficient training paradigm for unleashing the reasoning capabilities of pretrained LLMs in both mathematical and logical domains. By leveraging critiques on just one problem, One-Shot CFT enables models like Qwen and LLaMA to match or even outperform reinforcement learning, while using 20× less compute.
+
+Instead of learning from reference answers (as in supervised fine-tuning) or reward signals (as in reinforcement learning), One-Shot CFT enables models to learn from critiques of diverse solutions to a single problem, enhancing their exposure to varied reasoning patterns and mitigating overfitting. This exposes the LLMs to multiple perspectives and error types, thereby more effectively unleashing their reasoning potential. 
+
+
+## ✨ Key Highlights
+
+- **Unleashes Reasoning with One Example:** One-Shot CFT uses critiques of diverse model-generated solutions to a single problem to significantly boost performance across math and logic tasks. For example, with just 5 GPU hours of training on Qwen2.5-Math-7B, One-Shot CFT achieves an average improvement of +15% on six math benchmarks and +16% on three logic reasoning benchmarks.
+- **Outperforms RLVR and Full SFT with 20× Less Compute:** One-Shot CFT outperforms both one-shot Reinforcement Learning with Verifiable Rewards (RLVR) and full-dataset supervised fine-tuning, while requiring only 5 GPU hours on a 7B model—offering a much more efficient and stable training alternative.
+- **Robust Across Seeds and Model Scales:** One-Shot CFT remains effective across different seed problem choices and model sizes—from 1.5B to 14B parameters—demonstrating strong generalization and scalability.
+
+**This specific model is the One-Shot CFT variant trained based on [Qwen2.5-7B-Math](https://huggingface.co/Qwen/Qwen2.5-Math-7B) with [BBEH-CFT-TimeArithmetic-p0](https://huggingface.co/datasets/TIGER-Lab/One-Shot-CFT-Data) dataset.**
+
+
+## Main Results
+
+<p align="center">
+  <img src="https://cdn-uploads.huggingface.co/production/uploads/636a35eff8d9af4aea181608/DCxRSdeDrv-Db4VLuEl0T.png" alt="CFT Performance Comparison" width="1100"/>
+</p>
+
+<p align="center"><em>
+One-shot CFT consistently improves mathematical and logical reasoning.  
+<strong>Left:</strong> Average accuracy on six mathematical reasoning benchmarks for Qwen and LLaMA models, comparing base, SFT, RLVR, and CFT with only one training example.  
+<strong>Right:</strong> In-domain accuracy on three logic reasoning benchmarks (BBEH subtasks) for Qwen2.5-Math-7B.  
+Across both domains, CFT with a single problem significantly outperforms standard SFT and matches or exceeds reinforcement learning with much lower compute.
+</em></p>
+
+
+## Citation
+
+If you find our work helpful, please cite it as:
+
+```bibtex
+@article{wang2025critique,
+  title={Critique fine-tuning: Learning to critique is more effective than learning to imitate},
+  author={Wang, Yubo and Yue, Xiang and Chen, Wenhu},
+  journal={arXiv preprint arXiv:2501.17703},
+  year={2025}
+}
+```