 It didn't really popularly become called the White House until Teddy Roosevelt's time. The initial thought, sorry, the initial name for it was the President's Palace. And this was in the late 1700s when Washington and Madison died.