Deep Latent Variable Model for Learning Longitudinal Multi-view Data
  In many scientific problems such as video surveillance, modern genomic
analysis, and clinical studies, data are often collected from diverse domains
across time that exhibit time-dependent heterogeneous properties. It is
important to not only integrate data from multiple sources (called multiview
data), but also to incorporate time dependency for deep understanding of the
underlying system. Latent factor models are popular tools for exploring
multi-view data. However, it is frequently observed that these models do not
perform well for complex systems and they are not applicable to time-series
data. Therefore, we propose a generative model based on variational autoencoder
and recurrent neural network to infer the latent dynamic factors for
multivariate timeseries data. This approach allows us to identify the
disentangled latent embeddings across multiple modalities while accounting for
the time factor. We invoke our proposed model for analyzing three datasets on
which we demonstrate the effectiveness and the interpretability of the model.
