Towards Learning Causal Representations from Multi-Instance Bags
  Multi-instance learning (MIL) deals with objects represented as bags of
instances and can predict instance labels from bag-level supervision. However,
significant performance gaps exist between instance-level MIL algorithms and
supervised learners since the instance labels are unavailable in MIL. Most
existing MIL algorithms tackle the problem by treating multi-instance bags as
harmful ambiguities and predicting instance labels by reducing the supervision
inexactness. This work studies MIL from a new perspective by considering bags
as important auxiliary information that can be utilized to identify invariant
causal representations from bag-level weak supervision. We propose the
TargetedMIL algorithm, which not only excels at instance label prediction but
also is robust to distribution change by synergistically integrating MIL with
identifiable variational autoencoder based on a practical and general
assumption: the prior distribution over the instance latent representations
belongs to the non-factorized exponential family conditioning on the
multi-instance bags. Experiments on synthetic and real-world datasets
demonstrate that our approach significantly outperforms various baselines on
instance label prediction and out-of-distribution generalization tasks.
