So it's not just that people are having smaller families, it's that many more people are just not having any children at all, this according to the Census Bureau, as reported by the Wall Street Journal.