Burnside was born in Liberty, Indiana and was the fourth of nine children of Edghill and Pamela (or Pamilia) Brown Burnside, a family of Scottish origin.
Narodil se v Liberty, stát Indiana, jako čtvrté z devíti dětí Edghill a Pamely (nebo Pamilie) Brown Burnside, rodiny skotského původu.