Human vs. supervised machine learning: Who learns patterns faster?
  The capabilities of supervised machine learning (SML), especially compared to
human abilities, are being discussed in scientific research and in the usage of
SML. This study provides an answer to how learning performance differs between
humans and machines when there is limited training data. We have designed an
experiment in which 44 humans and three different machine learning algorithms
identify patterns in labeled training data and have to label instances
according to the patterns they find. The results show a high dependency between
performance and the underlying patterns of the task. Whereas humans perform
relatively similarly across all patterns, machines show large performance
differences for the various patterns in our experiment. After seeing 20
instances in the experiment, human performance does not improve anymore, which
we relate to theories of cognitive overload. Machines learn slower but can
reach the same level or may even outperform humans in 2 of the 4 of used
patterns. However, machines need more instances compared to humans for the same
results. The performance of machines is comparably lower for the other 2
patterns due to the difficulty of combining input features.
