A Batch, Off-Policy, Actor-Critic Algorithm for Optimizing the Average   Reward
  We develop an off-policy actor-critic algorithm for learning an optimal policy from a training set composed of data from multiple individuals. This algorithm is developed with a view towards its use in mobile health. 
S.A. Murphy, Y. Deng, E.B. Laber, H.R. Maei, R.S. Sutton, K.   Witkiewitz
stat.ML cs.LG