On Bock's Conjecture Regarding the Adam Optimizer
  In 2014, Kingma and Ba published their Adam optimizer algorithm, together
with a mathematical argument that was meant to help justify it. In 2018, Bock
and colleagues reported that a key piece was missing from that argument $-$ an
unproven lemma which we will call Bock's conjecture. Here we show that this
conjecture is false, but we prove a modified version of it which can take its
place in analyses of Adam.
