 Born in Detroit, Michigan on September 6, 1941, right after his family had moved north from Augusta, Georgia, General Baker's father worked for McMinn Steel in the 1940s and later in a job with Chrysler. The Baker family settled in a home in southwest Detroit. General Baker grew up in a union household and often attended union events with his father. Baker graduated early from the nominally integrated Southwestern High School in 1958.