Beam Search: Why do some beams begin with the same token?
I am confused about two observations regarding beam search:From reading@patrickvonplatenHow to generate text: using different decoding methods for language generation with Transformers](https://Howto generate text: using different decoding methods for language generation with Transformers), it is my understanding that each beam inBeamSearchEncoderDecoderOutputshould begin with a different token, or am I wrong in that assertion?ThedocumentationforBeamSearchEncoderDecoderOutputfor thesequencesparameter states that “The second dimension (sequence_length) is either equal tomax_lengthor shorter if all batches finished early due to theeos_token_id.”. In my observations it’s always been longer thanmax_length. How come?Thanks