Among the areas hit hardest were Los Angeles, Miami and San Diego, according to new data from the Census Bureau