Unsupervised Keyword Extraction for Full-sentence VQA
  In the majority of the existing Visual Question Answering (VQA) research, the
answers consist of short, often single words, as per instructions given to the
annotators during dataset construction. This study envisions a VQA task for
natural situations, where the answers are more likely to be sentences rather
than single words. To bridge the gap between this natural VQA and existing VQA
approaches, a novel unsupervised keyword extraction method is proposed. The
method is based on the principle that the full-sentence answers can be
decomposed into two parts: one that contains new information answering the
question (i.e., keywords), and one that contains information already included
in the question. Discriminative decoders were designed to achieve such
decomposition, and the method was experimentally implemented on VQA datasets
containing full-sentence answers. The results show that the proposed model can
accurately extract the keywords without being given explicit annotations
describing them.
