Scaling Scaling Laws with Board Games
  The largest experiments in machine learning now require resources far beyond
the budget of all but a few institutions. Fortunately, it has recently been
shown that the results of these huge experiments can often be extrapolated from
the results of a sequence of far smaller, cheaper experiments. In this work, we
show that not only can the extrapolation be done based on the size of the
model, but on the size of the problem as well. By conducting a sequence of
experiments using AlphaZero and Hex, we show that the performance achievable
with a fixed amount of compute degrades predictably as the game gets larger and
harder. Along with our main result, we further show that the test-time and
train-time compute available to an agent can be traded off while maintaining
performance.
