Detection of Dataset Shifts in Learning-Enabled Cyber-Physical Systems
  using Variational Autoencoder for Regression
  Cyber-physical systems (CPSs) use learning-enabled components (LECs)
extensively to cope with various complex tasks under high-uncertainty
environments. However, the dataset shifts between the training and testing
phase may lead the LECs to become ineffective to make large-error predictions,
and further, compromise the safety of the overall system. In our paper, we
first provide the formal definitions for different types of dataset shifts in
learning-enabled CPS. Then, we propose an approach to detect the dataset shifts
effectively for regression problems. Our approach is based on the inductive
conformal anomaly detection and utilizes a variational autoencoder for
regression model which enables the approach to take into consideration both LEC
input and output for detecting dataset shifts. Additionally, in order to
improve the robustness of detection, layer-wise relevance propagation (LRP) is
incorporated into our approach. We demonstrate our approach by using an
advanced emergency braking system implemented in an open-source simulator for
self-driving cars. The evaluation results show that our approach can detect
different types of dataset shifts with a small number of false alarms while the
execution time is smaller than the sampling period of the system.
