Enabling Deep Learning for All-in EDGE paradigm
  Deep Learning-based models have been widely investigated, and they have
demonstrated significant performance on non-trivial tasks such as speech
recognition, image processing, and natural language understanding. However,
this is at the cost of substantial data requirements. Considering the
widespread proliferation of edge devices (e.g. Internet of Things devices) over
the last decade, Deep Learning in the edge paradigm, such as device-cloud
integrated platforms, is required to leverage its superior performance.
Moreover, it is suitable from the data requirements perspective in the edge
paradigm because the proliferation of edge devices has resulted in an explosion
in the volume of generated and collected data. However, there are difficulties
due to other requirements such as high computation, high latency, and high
bandwidth caused by Deep Learning applications in real-world scenarios. In this
regard, this survey paper investigates Deep Learning at the edge, its
architecture, enabling technologies, and model adaption techniques, where edge
servers and edge devices participate in deep learning training and inference.
For simplicity, we call this paradigm the All-in EDGE paradigm. Besides, this
paper presents the key performance metrics for Deep Learning at the All-in EDGE
paradigm to evaluate various deep learning techniques and choose a suitable
design. Moreover, various open challenges arising from the deployment of Deep
Learning at the All-in EDGE paradigm are identified and discussed.
