Question about LM adapted T5 dataset
Hi all,

Thank you for your effort for these work. I have a little question about the split point of the input source. As mentioned in T5 paper, they choose a random point to split it into prefix and target portions. However, you set a specific length to split text sequence into two parts as shown in the following code

https://github.com/NVIDIA/NeMo/blob/49183b7c59c3b4243671d5eb4d3f202a4e4739ce/nemo/collections/nlp/data/language_modeling/megatron/lm_adapted_t5_dataset.py#L49-L52

I am curious about this part. Could you please explain why this set is different from T5 paper? Thank you in advance.
