A Batch, Off-Policy, Actor-Critic Algorithm for Optimizing the Average
  Reward
  We develop an off-policy actor-critic algorithm for learning an optimal
policy from a training set composed of data from multiple individuals. This
algorithm is developed with a view towards its use in mobile health.
