Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural
  Network Explanations
  The evaluation of explanation methods is a research topic that has not yet
been explored deeply, however, since explainability is supposed to strengthen
trust in artificial intelligence, it is necessary to systematically review and
compare explanation methods in order to confirm their correctness. Until now,
no tool exists that exhaustively and speedily allows researchers to
quantitatively evaluate explanations of neural network predictions. To increase
transparency and reproducibility in the field, we therefore built Quantus - a
comprehensive, open-source toolkit in Python that includes a growing,
well-organised collection of evaluation metrics and tutorials for evaluating
explainable methods. The toolkit has been thoroughly tested and is available
under open source license on PyPi (or on
https://github.com/understandable-machine-intelligence-lab/quantus/).
