Explaining and Interpreting LSTMs
  While neural networks have acted as a strong unifying force in the design of
modern AI systems, the neural network architectures themselves remain highly
heterogeneous due to the variety of tasks to be solved. In this chapter, we
explore how to adapt the Layer-wise Relevance Propagation (LRP) technique used
for explaining the predictions of feed-forward networks to the LSTM
architecture used for sequential data modeling and forecasting. The special
accumulators and gated interactions present in the LSTM require both a new
propagation scheme and an extension of the underlying theoretical framework to
deliver faithful explanations.
