Toward Formal Data Set Verification for Building Effective Machine
  Learning Models
  In order to properly train a machine learning model, data must be properly
collected. To guarantee a proper data collection, verifying that the collected
data set holds certain properties is a possible solution. For example,
guaranteeing that the data set contains samples across the whole input space,
or that the data set is balanced w.r.t. different classes. We present a formal
approach for verifying a set of arbitrarily stated properties over a data set.
The proposed approach relies on the transformation of the data set into a first
order logic formula, which can be later verified w.r.t. the different
properties also stated in the same logic. A prototype tool, which uses the z3
solver, has been developed; the prototype can take as an input a set of
properties stated in a formal language and formally verify a given data set
w.r.t. to the given set of properties. Preliminary experimental results show
the feasibility and performance of the proposed approach, and furthermore the
flexibility for expressing properties of interest.
