Correct logic flaws in the following text.
Via careful data cleaning and filtering, our transformer-based pretrained model without any finetuning achieves remarkable results over various news summarization tasks.
We collect a massive news corpus and conduct data cleaning and filtering, our transformer-based pretrained model without any finetuning achieves remarkable results over various news summarization tasks.