A Distributed Learning Dynamics in Social Groups
  We study a distributed learning process observed in human groups and other
social animals. This learning process appears in settings in which each
individual in a group is trying to decide over time, in a distributed manner,
which option to select among a shared set of options. Specifically, we consider
a stochastic dynamics in a group in which every individual selects an option in
the following two-step process: (1) select a random individual and observe the
option that individual chose in the previous time step, and (2) adopt that
option if its stochastic quality was good at that time step. Various
instantiations of such distributed learning appear in nature, and have also
been studied in the social science literature. From the perspective of an
individual, an attractive feature of this learning process is that it is a
simple heuristic that requires extremely limited computational capacities. But
what does it mean for the group -- could such a simple, distributed and
essentially memoryless process lead the group as a whole to perform optimally?
We show that the answer to this question is yes -- this distributed learning is
highly effective at identifying the best option and is close to optimal for the
group overall. Our analysis also gives quantitative bounds that show fast
convergence of these stochastic dynamics. Prior to our work the only
theoretical work related to such learning dynamics has been either in
deterministic special cases or in the asymptotic setting. Finally, we observe
that our infinite population dynamics is a stochastic variant of the classic
multiplicative weights update (MWU) method. Consequently, we arrive at the
following interesting converse: the learning dynamics on a finite population
considered here can be viewed as a novel distributed and low-memory
implementation of the classic MWU method.
