Question on text input in image captioning
I was going through thisblogon image captioning.According to the blog, theVisionEncoderDecoderModeluses this kind of architecture (shown below) where the image embeddings are fed to the decoder via theEncoder-Decoder Self-Attention.What I wanted to ask is that if the input is only image then what are we feeding as input (denoted byText Captionin the image) to the Transformer decoder?