This collection contains the models developed in the paper: "Improving Recursive Transformers with Mixture of LoRAs"