Learning Perceptual Concepts by Bootstrapping from Human Queries
  Robots need to be able to learn concepts from their users in order to adapt
their capabilities to each user's unique task. But when the robot operates on
high-dimensional inputs, like images or point clouds, this is impractical: the
robot needs an unrealistic amount of human effort to learn the new concept. To
address this challenge, we propose a new approach whereby the robot learns a
low-dimensional variant of the concept and uses it to generate a larger data
set for learning the concept in the high-dimensional space. This lets it take
advantage of semantically meaningful privileged information only accessible at
training time, like object poses and bounding boxes, that allows for richer
human interaction to speed up learning. We evaluate our approach by learning
prepositional concepts that describe object state or multi-object
relationships, like above, near, or aligned, which are key to user
specification of task goals and execution constraints for robots. Using a
simulated human, we show that our approach improves sample complexity when
compared to learning concepts directly in the high-dimensional space. We also
demonstrate the utility of the learned concepts in motion planning tasks on a
7-DoF Franka Panda robot.
