Hybrid Federated Learning: Algorithms and Implementation
  Federated learning (FL) is a recently proposed distributed machine learning
paradigm dealing with distributed and private data sets. Based on the data
partition pattern, FL is often categorized into horizontal, vertical, and
hybrid settings. Despite the fact that many works have been developed for the
first two approaches, the hybrid FL setting (which deals with partially
overlapped feature space and sample space) remains less explored, though this
setting is extremely important in practice. In this paper, we first set up a
new model-matching-based problem formulation for hybrid FL, then propose an
efficient algorithm that can collaboratively train the global and local models
to deal with full and partial featured data. We conduct numerical experiments
on the multi-view ModelNet40 data set to validate the performance of the
proposed algorithm. To the best of our knowledge, this is the first formulation
and algorithm developed for the hybrid FL.
