Monte Carlo EM for Deep Time Series Anomaly Detection
  Time series data are often corrupted by outliers or other kinds of anomalies.
Identifying the anomalous points can be a goal on its own (anomaly detection),
or a means to improving performance of other time series tasks (e.g.
forecasting). Recent deep-learning-based approaches to anomaly detection and
forecasting commonly assume that the proportion of anomalies in the training
data is small enough to ignore, and treat the unlabeled data as coming from the
nominal data distribution. We present a simple yet effective technique for
augmenting existing time series models so that they explicitly account for
anomalies in the training data. By augmenting the training data with a latent
anomaly indicator variable whose distribution is inferred while training the
underlying model using Monte Carlo EM, our method simultaneously infers
anomalous points while improving model performance on nominal data. We
demonstrate the effectiveness of the approach by combining it with a simple
feed-forward forecasting model. We investigate how anomalies in the train set
affect the training of forecasting models, which are commonly used for time
series anomaly detection, and show that our method improves the training of the
model.
