Gaussian Graphical Model Selection for Huge Data via Minipatch Learning
  Gaussian graphical models are essential unsupervised learning techniques to
estimate conditional dependence relationships between sets of nodes. While
graphical model selection is a well-studied problem with many popular
techniques, there are typically three key practical challenges: i) many
existing methods become computationally intractable in huge-data settings with
tens of thousands of nodes; ii) the need for separate data-driven tuning
hyperparameter selection procedures considerably adds to the computational
burden; iii) the statistical accuracy of selected edges often deteriorates as
the dimension and/or the complexity of the underlying graph structures
increase. We tackle these problems by proposing the Minipatch Graph (MPGraph)
estimator. Our approach builds upon insights from the latent variable graphical
model problem and utilizes ensembles of thresholded graph estimators fit to
tiny, random subsets of both the observations and the nodes, termed
minipatches. As estimates are fit on small problems, our approach is
computationally fast with integrated stability-based hyperparameter tuning.
Additionally, we prove that under certain conditions our MPGraph algorithm
achieves finite-sample graph selection consistency. We compare our approach to
state-of-the-art computational approaches to Gaussian graphical model selection
including the BigQUIC algorithm, and empirically demonstrate that our approach
is not only more accurate but also extensively faster for huge graph selection
problems.
