US population growth over the last 50 years has been driven by immigrants, longer life spans and Asian and Hispanic Americans.