Deep Reinforcement Learning for Neural Control
  We present a novel methodology for control of neural circuits based on deep
reinforcement learning. Our approach achieves aimed behavior by generating
external continuous stimulation of existing neural circuits (neuromodulation
control) or modulations of neural circuits architecture (connectome control).
Both forms of control are challenging due to nonlinear and recurrent complexity
of neural activity. To infer candidate control policies, our approach maps
neural circuits and their connectome into a grid-world like setting and infers
the actions needed to achieve aimed behavior. The actions are inferred by
adaptation of deep Q-learning methods known for their robust performance in
navigating grid-worlds. We apply our approach to the model of \textit{C.
elegans} which simulates the full somatic nervous system with muscles and body.
Our framework successfully infers neuropeptidic currents and synaptic
architectures for control of chemotaxis. Our findings are consistent with in
vivo measurements and provide additional insights into neural control of
chemotaxis. We further demonstrate the generality and scalability of our
methods by inferring chemotactic neural circuits from scratch.
