Classification with Nearest Disjoint Centroids
  In this paper, we develop a new classification method based on nearest
centroid, and it is called the nearest disjoint centroid classifier. Our method
differs from the nearest centroid classifier in the following two aspects: (1)
the centroids are defined based on disjoint subsets of features instead of all
the features, and (2) the distance is induced by the dimensionality-normalized
norm instead of the Euclidean norm. We provide a few theoretical results
regarding our method. In addition, we propose a simple algorithm based on
adapted k-means clustering that can find the disjoint subsets of features used
in our method, and extend the algorithm to perform feature selection. We
evaluate and compare the performance of our method to other classification
methods on both simulated data and real-world gene expression datasets. The
results demonstrate that our method is able to outperform other competing
classifiers by having smaller misclassification rates and/or using fewer
features in various settings and situations.
