Performance Analysis and Characterization of Training Deep Learning
  Models on Mobile Devices
  Training deep learning models on mobile devices recently becomes possible,
because of increasing computation power on mobile hardware and the advantages
of enabling high user experiences. Most of the existing work on machine
learning at mobile devices is focused on the inference of deep learning models
(particularly convolutional neural network and recurrent neural network), but
not training. The performance characterization of training deep learning models
on mobile devices is largely unexplored, although understanding the performance
characterization is critical for designing and implementing deep learning
models on mobile devices.
  In this paper, we perform a variety of experiments on a representative mobile
device (the NVIDIA TX2) to study the performance of training deep learning
models. We introduce a benchmark suite and tools to study performance of
training deep learning models on mobile devices, from the perspectives of
memory consumption, hardware utilization, and power consumption. The tools can
correlate performance results with fine-grained operations in deep learning
models, providing capabilities to capture performance variance and problems at
a fine granularity. We reveal interesting performance problems and
opportunities, including under-utilization of heterogeneous hardware, large
energy consumption of the memory, and high predictability of workload
characterization. Based on the performance analysis, we suggest interesting
research directions.
