Functional Transparency for Structured Data: a Game-Theoretic Approach
  We provide a new approach to training neural models to exhibit transparency
in a well-defined, functional manner. Our approach naturally operates over
structured data and tailors the predictor, functionally, towards a chosen
family of (local) witnesses. The estimation problem is setup as a co-operative
game between an unrestricted predictor such as a neural network, and a set of
witnesses chosen from the desired transparent family. The goal of the witnesses
is to highlight, locally, how well the predictor conforms to the chosen family
of functions, while the predictor is trained to minimize the highlighted
discrepancy. We emphasize that the predictor remains globally powerful as it is
only encouraged to agree locally with locally adapted witnesses. We analyze the
effect of the proposed approach, provide example formulations in the context of
deep graph and sequence models, and empirically illustrate the idea in chemical
property prediction, temporal modeling, and molecule representation learning.
