Tensor-Based Backpropagation in Neural Networks with Non-Sequential
  Input
  Neural networks have been able to achieve groundbreaking accuracy at tasks
conventionally considered only doable by humans. Using stochastic gradient
descent, optimization in many dimensions is made possible, albeit at a
relatively high computational cost. By splitting training data into batches,
networks can be distributed and trained vastly more efficiently and with
minimal accuracy loss. We have explored the mathematics behind efficiently
implementing tensor-based batch backpropagation algorithms. A common approach
to batch training is iterating over batch items individually. Explicitly using
tensor operations to backpropagate allows training to be performed
non-linearly, increasing computational efficiency.
