 It was like in 1845, James K. Polk was president. The population had grown to about 20 million people. Out of that, or on top of that, the slave population was about two and a half million, eventually to rise close to four million before its abolishment. Several million immigrants were starting to come into the U.S. at that point.