Deep Learning on Multimodal Sensor Data at the Wireless Edge for
  Vehicular Network
  Beam selection for millimeter-wave links in a vehicular scenario is a
challenging problem, as an exhaustive search among all candidate beam pairs
cannot be assuredly completed within short contact times. We solve this problem
via a novel expediting beam selection by leveraging multimodal data collected
from sensors like LiDAR, camera images, and GPS. We propose individual modality
and distributed fusion-based deep learning (F-DL) architectures that can
execute locally as well as at a mobile edge computing center (MEC), with a
study on associated tradeoffs. We also formulate and solve an optimization
problem that considers practical beam-searching, MEC processing and
sensor-to-MEC data delivery latency overheads for determining the output
dimensions of the above F-DL architectures. Results from extensive evaluations
conducted on publicly available synthetic and home-grown real-world datasets
reveal 95% and 96% improvement in beam selection speed over classical RF-only
beam sweeping, respectively. F-DL also outperforms the state-of-the-art
techniques by 20-22% in predicting top-10 best beam pairs.
