Reducing Artificial Neural Network Complexity: A Case Study on Exoplanet
  Detection
  Despite their successes in the field of self-learning AI, Convolutional
Neural Networks (CNNs) suffer from having too many trainable parameters,
impacting computational performance. Several approaches have been proposed to
reduce the number of parameters in the visual domain, the Inception
architecture [Szegedy et al., 2016] being a prominent example. This raises the
question whether the number of trainable parameters in CNNs can also be reduced
for 1D inputs, such as time-series data, without incurring a substantial loss
in classification performance. We propose and examine two methods for
complexity reduction in AstroNet [Shallue & Vanderburg, 2018], a CNN for
automatic classification of time-varying brightness data of stars to detect
exoplanets. The first method makes only a tactical reduction of layers in
AstroNet while the second method also modifies the original input data by means
of a Gaussian pyramid. We conducted our experiments with various degrees of
dropout regularization. Our results show only a non-substantial loss in
accuracy compared to the original AstroNet, while reducing training time up to
85 percent. These results show potential for similar reductions in other CNN
applications while largely retaining accuracy.
