Bridging the Last Mile in Sim-to-Real Robot Perception via Bayesian
  Active Learning
  Learning from synthetic data is popular in a variety of robotic vision tasks
such as object detection, because a large amount of data can be generated
without annotations by humans. However, when relying only on synthetic data,we
encounter the well-known problem of the simulation-to-reality (Sim-to-Real)
gap, which is hard to resolve completely in practice. For such cases, real
human-annotated data is necessary to bridge this gap, and in our work we focus
on howto acquire this data efficiently. Therefore, we propose a Sim-to-Real
pipeline that relies on deep Bayesian active learning and aims to minimize the
manual annotation efforts. We devise a learning paradigm that autonomously
selects the data that is considered useful for the human expert to annotate. To
achieve this, a Bayesian Neural Network (BNN) object detector providing
reliable uncertain estimates is adapted to infer the informativeness of the
unlabeled data, in order to perform active learning. In our experiments on two
object detection data sets, we show that the labeling effort required to bridge
the reality gap can be reduced to a small amount. Furthermore, we demonstrate
the practical effectiveness of this idea in a grasping task on an assistive
robot.
