ML4ML: Automated Invariance Testing for Machine Learning Models
  In machine learning workflows, determining invariance qualities of a model is
a common testing procedure. In this paper, we propose an automatic testing
framework that is applicable to a variety of invariance qualities. We draw an
analogy between invariance testing and medical image analysis and propose to
use variance matrices as ``imagery'' testing data. This enables us to employ
machine learning techniques for analysing such ``imagery'' testing data
automatically, hence facilitating ML4ML (machine learning for machine
learning). We demonstrate the effectiveness and feasibility of the proposed
framework by developing ML4ML models (assessors) for determining rotation-,
brightness-, and size-variances of a collection of neural networks. Our testing
results show that the trained ML4ML assessors can perform such analytical tasks
with sufficient accuracy.
