Necessary and Sufficient Conditions for Inverse Reinforcement Learning
  of Bayesian Stopping Time Problems
  This paper presents an inverse reinforcement learning~(IRL) framework for
Bayesian stopping time problems. By observing the actions of a Bayesian
decision maker, we provide a necessary and sufficient condition to identify if
these actions are consistent with optimizing a cost function. In a Bayesian
(partially observed) setting, the inverse learner can at best identify
optimality wrt the observed actions. Our IRL algorithm identifies optimality
and then constructs set valued estimates of the cost function. To achieve this
IRL objective, we use novel ideas from Bayesian revealed preferences stemming
from microeconomics. We illustrate the proposed IRL scheme using two important
examples of stopping time problems, namely, sequential hypothesis testing and
Bayesian search. Finally, for finite datasets, we propose an IRL detection
algorithm and give finite sample bounds on its error probabilities.
