Machine learning-based conditional mean filter: a generalization of the
  ensemble Kalman filter for nonlinear data assimilation
  Filtering is a data assimilation technique that performs the sequential
inference of dynamical systems states from noisy observations. Herein, we
propose a machine learning-based ensemble conditional mean filter (ML-EnCMF)
for tracking possibly high-dimensional non-Gaussian state models with nonlinear
dynamics based on sparse observations. The proposed filtering method is
developed based on the conditional expectation and numerically implemented
using machine learning (ML) techniques combined with the ensemble method. The
contribution of this work is twofold. First, we demonstrate that the ensembles
assimilated using the ensemble conditional mean filter (EnCMF) provide an
unbiased estimator of the Bayesian posterior mean, and their variance matches
the expected conditional variance. Second, we implement the EnCMF using
artificial neural networks, which have a significant advantage in representing
nonlinear functions over high-dimensional domains such as the conditional mean.
Finally, we demonstrate the effectiveness of the ML-EnCMF for tracking the
states of Lorenz-63 and Lorenz-96 systems under the chaotic regime. Numerical
results show that the ML-EnCMF outperforms the ensemble Kalman filter.
