Introducing explainable supervised machine learning into interactive
  feedback loops for statistical production system
  Statistical production systems cover multiple steps from the collection,
aggregation, and integration of data to tasks like data quality assurance and
dissemination. While the context of data quality assurance is one of the most
promising fields for applying machine learning, the lack of curated and labeled
training data is often a limiting factor.
  The statistical production system for the Centralised Securities Database
features an interactive feedback loop between data collected by the European
Central Bank and data quality assurance performed by data quality managers at
National Central Banks. The quality assurance feedback loop is based on a set
of rule-based checks for raising exceptions, upon which the user either
confirms the data or corrects an actual error.
  In this paper we use the information received from this feedback loop to
optimize the exceptions presented to the National Central Banks thereby
improving the quality of exceptions generated and the time consumed on the
system by the users authenticating those exceptions. For this approach we make
use of explainable supervised machine learning to (a) identify the types of
exceptions and (b) to prioritize which exceptions are more likely to require an
intervention or correction by the NCBs. Furthermore, we provide an explainable
AI taxonomy aiming to identify the different explainable AI needs that arose
during the project.
