Do Hispanic families have too many kids or is it really that white families have too few?

I constantly hear nagging that Hispanics have too many kids (I'm the 3rd of 5), but let's look at some facts. In order to keep a group from declining you must have at least a 2.11 fertility rate, lower will result in a population decline (which is really bad if you look at Japan). Non-Hispanic fertility rate is 1.6, which is very low and wont sustain itself, with Hispanics put into the picture the fertility rate just barely reaches 2.11. Don't believe me? Look at Harris County in Texas, one of the fastest growing areas in the country and a very large county, yet the white population declined 500,000 people. The population in the 2010 census had one of the lowest population % increases in the century. So is it really Hispanic families have too many kids, or white families have too few?