Enhancing Explainability of Hyperparameter Optimization via Bayesian
  Algorithm Execution
  Despite all the benefits of automated hyperparameter optimization (HPO), most
modern HPO algorithms are black-boxes themselves. This makes it difficult to
understand the decision process which lead to the selected configuration,
reduces trust in HPO, and thus hinders its broad adoption. Here, we study the
combination of HPO with interpretable machine learning (IML) methods such as
partial dependence plots. However, if such methods are naively applied to the
experimental data of the HPO process in a post-hoc manner, the underlying
sampling bias of the optimizer can distort interpretations. We propose a
modified HPO method which efficiently balances the search for the global
optimum w.r.t. predictive performance and the reliable estimation of IML
explanations of an underlying black-box function by coupling Bayesian
optimization and Bayesian Algorithm Execution. On benchmark cases of both
synthetic objectives and HPO of a neural network, we demonstrate that our
method returns more reliable explanations of the underlying black-box without a
loss of optimization performance.
