XDeep: An Interpretation Tool for Deep Neural Networks
  XDeep is an open-source Python package developed to interpret deep models for
both practitioners and researchers. Overall, XDeep takes a trained deep neural
network (DNN) as the input, and generates relevant interpretations as the
output with the post-hoc manner. From the functionality perspective, XDeep
integrates a wide range of interpretation algorithms from the
state-of-the-arts, covering different types of methodologies, and is capable of
providing both local explanation and global explanation for DNN when
interpreting model behaviours. With the well-documented API designed in XDeep,
end-users can easily obtain the interpretations for their deep models at hand
with several lines of codes, and compare the results among different
algorithms. XDeep is generally compatible with Python 3, and can be installed
through Python Package Index (PyPI). The source codes are available at:
https://github.com/datamllab/xdeep.
