Improving Sequential Query Recommendation with Immediate User Feedback
  We propose an algorithm for next query recommendation in interactive data
exploration settings, like knowledge discovery for information gathering. The
state-of-the-art query recommendation algorithms are based on
sequence-to-sequence learning approaches that exploit historical interaction
data. We propose to augment the transformer-based causal language models for
query recommendations to adapt to the immediate user feedback using multi-armed
bandit (MAB) framework. We conduct a large-scale experimental study using log
files from a popular online literature discovery service and demonstrate that
our algorithm improves the cumulative regret substantially, with respect to the
state-of-the-art transformer-based query recommendation models, which do not
make use of the immediate user feedback. Our data model and source code are
available at ~\url{https://anonymous.4open.science/r/exp3_ss-9985/}.
