Sample Complexity Result for Multi-category Classifiers of Bounded
  Variation
  We control the probability of the uniform deviation between empirical and
generalization performances of multi-category classifiers by an empirical L1
-norm covering number when these performances are defined on the basis of the
truncated hinge loss function. The only assumption made on the functions
implemented by multi-category classifiers is that they are of bounded variation
(BV). For such classifiers, we derive the sample size estimate sufficient for
the mentioned performances to be close with high probability. Particularly, we
are interested in the dependency of this estimate on the number C of classes.
To this end, first, we upper bound the scale-sensitive version of the
VC-dimension, the fat-shattering dimension of sets of BV functions defined on
R^d which gives a O(1/epsilon^d ) as the scale epsilon goes to zero. Secondly,
we provide a sharper decomposition result for the fat-shattering dimension in
terms of C, which for sets of BV functions gives an improvement from O(C^(d/2
+1)) to O(Cln^2(C)). This improvement then propagates to the sample complexity
estimate.
