View selection in multi-view stacking: Choosing the meta-learner
  Multi-view stacking is a framework for combining information from different
views (i.e. different feature sets) describing the same set of objects. In this
framework, a base-learner algorithm is trained on each view separately, and
their predictions are then combined by a meta-learner algorithm. In a previous
study, stacked penalized logistic regression, a special case of multi-view
stacking, has been shown to be useful in identifying which views are most
important for prediction. In this article we expand this research by
considering seven different algorithms to use as the meta-learner, and
evaluating their view selection and classification performance in simulations
and two applications on real gene-expression data sets. Our results suggest
that if both view selection and classification accuracy are important to the
research at hand, then the nonnegative lasso, nonnegative adaptive lasso and
nonnegative elastic net are suitable meta-learners. Exactly which among these
three is to be preferred depends on the research context. The remaining four
meta-learners, namely nonnegative ridge regression, nonnegative forward
selection, stability selection and the interpolating predictor, show little
advantages in order to be preferred over the other three.
