Self Reward Design with Fine-grained Interpretability
  Transparency and fairness issues stem from the black-box nature of deep
neural networks (DNN). They are relevant to Deep Reinforcement Learning which
also use DNN to learn its policy, value functions etc. This paper proposes a
way to circumvent the issues through the bottom-up design of neural networks
(NN) with detailed interpretability, where each neuron or layer has its own
meaning and utility that corresponds to humanly understandable concept. With
deliberate design, we show that lavaland problems can be solved using NN model
with few parameters. Furthermore, we introduce the Self Reward Design (SRD),
inspired by the Inverse Reward Design, so that our interpretable design can (1)
solve the problem by pure design (although imperfectly) (2) be optimized via
SRD (3) perform avoidance of unknown states by recognizing the inactivations of
neurons aggregated as the activation in \(w_{unknown}\).
