Driving Style Encoder: Situational Reward Adaptation for General-Purpose
  Planning in Automated Driving
  General-purpose planning algorithms for automated driving combine mission,
behavior, and local motion planning. Such planning algorithms map features of
the environment and driving kinematics into complex reward functions. To
achieve this, planning experts often rely on linear reward functions. The
specification and tuning of these reward functions is a tedious process and
requires significant experience. Moreover, a manually designed linear reward
function does not generalize across different driving situations. In this work,
we propose a deep learning approach based on inverse reinforcement learning
that generates situation-dependent reward functions. Our neural network
provides a mapping between features and actions of sampled driving policies of
a model-predictive control-based planner and predicts reward functions for
upcoming planning cycles. In our evaluation, we compare the driving style of
reward functions predicted by our deep network against clustered and linear
reward functions. Our proposed deep learning approach outperforms clustered
linear reward functions and is at par with linear reward functions with
a-priori knowledge about the situation.
