Robust Coreset Construction for Distributed Machine Learning
  Coreset, which is a summary of the original dataset in the form of a small
weighted set in the same sample space, provides a promising approach to enable
machine learning over distributed data. Although viewed as a proxy of the
original dataset, each coreset is only designed to approximate the cost
function of a specific machine learning problem, and thus different coresets
are often required to solve different machine learning problems, increasing the
communication overhead. We resolve this dilemma by developing robust coreset
construction algorithms that can support a variety of machine learning
problems. Motivated by empirical evidence that suitably-weighted k-clustering
centers provide a robust coreset, we harden the observation by establishing
theoretical conditions under which the coreset provides a guaranteed
approximation for a broad range of machine learning problems, and developing
both centralized and distributed algorithms to generate coresets satisfying the
conditions. The robustness of the proposed algorithms is verified through
extensive experiments on diverse datasets with respect to both supervised and
unsupervised learning problems.
