ignatius/cyT5-small

cyT5-small is a light-weight (alpha-version) Welsh T5 model extracted from the google/mt5-small model and fine-tuned only on the Welsh summarization dataset.

Citation: Introducing the Welsh Text Summarisation Dataset and Baseline Systems.

@article{ezeani2022introducing,
  title={Introducing the Welsh text summarisation dataset and baseline systems},
  author={Ezeani, Ignatius and El-Haj, Mahmoud and Morris, Jonathan and Knight, Dawn},
  journal={arXiv preprint arXiv:2205.02545},
  year={2022}
}

Further developments are ongoing and will update will be shared soon.