Handling Non-ignorably Missing Features in Electronic Health Records
  Data Using Importance-Weighted Autoencoders
  Electronic Health Records (EHRs) are commonly used to investigate
relationships between patient health information and outcomes. Deep learning
methods are emerging as powerful tools to learn such relationships, given the
characteristic high dimension and large sample size of EHR datasets. The
Physionet 2012 Challenge involves an EHR dataset pertaining to 12,000 ICU
patients, where researchers investigated the relationships between clinical
measurements, and in-hospital mortality. However, the prevalence and complexity
of missing data in the Physionet data present significant challenges for the
application of deep learning methods, such as Variational Autoencoders (VAEs).
Although a rich literature exists regarding the treatment of missing data in
traditional statistical models, it is unclear how this extends to deep learning
architectures. To address these issues, we propose a novel extension of VAEs
called Importance-Weighted Autoencoders (IWAEs) to flexibly handle Missing Not
At Random (MNAR) patterns in the Physionet data. Our proposed method models the
missingness mechanism using an embedded neural network, eliminating the need to
specify the exact form of the missingness mechanism a priori. We show that the
use of our method leads to more realistic imputed values relative to the
state-of-the-art, as well as significant differences in fitted downstream
models for mortality.
