view post Post 1847 New GRPO + TRL free Colab notebook out! 🔥Fine-tune 7B+ models on T4 GPUs thanks to a ton of memory optimizations for GRPO 7B model uses only 9.2 GB VRAM (~7× reduction) 🤯Try the notebook here 👉 https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_trl_lora_qlora.ipynb See translation 🔥 7 7 👍 2 2 + Reply