HyperSTAR: Task-Aware Hyperparameters for Deep Networks
  While deep neural networks excel in solving visual recognition tasks, they
require significant effort to find hyperparameters that make them work
optimally. Hyperparameter Optimization (HPO) approaches have automated the
process of finding good hyperparameters but they do not adapt to a given task
(task-agnostic), making them computationally inefficient. To reduce HPO time,
we present HyperSTAR (System for Task Aware Hyperparameter Recommendation), a
task-aware method to warm-start HPO for deep neural networks. HyperSTAR ranks
and recommends hyperparameters by predicting their performance conditioned on a
joint dataset-hyperparameter space. It learns a dataset (task) representation
along with the performance predictor directly from raw images in an end-to-end
fashion. The recommendations, when integrated with an existing HPO method, make
it task-aware and significantly reduce the time to achieve optimal performance.
We conduct extensive experiments on 10 publicly available large-scale image
classification datasets over two different network architectures, validating
that HyperSTAR evaluates 50% less configurations to achieve the best
performance compared to existing methods. We further demonstrate that HyperSTAR
makes Hyperband (HB) task-aware, achieving the optimal accuracy in just 25% of
the budget required by both vanilla HB and Bayesian Optimized HB~(BOHB).
